Aug 29 13:03:35 devstack cinder-volume[74817]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 29 13:03:35 devstack cinder-volume[74817]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 29 13:03:35 devstack cinder-volume[74817]: we strongly recommend against using it for new projects.
Aug 29 13:03:35 devstack cinder-volume[74817]: If you are already using Eventlet, we recommend migrating to a different
Aug 29 13:03:35 devstack cinder-volume[74817]: framework.  For more detail see
Aug 29 13:03:35 devstack cinder-volume[74817]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 29 13:03:35 devstack cinder-volume[74817]:   import eventlet  # noqa
Aug 29 13:03:38 devstack cinder-volume[74817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 29 13:03:38 devstack cinder-volume[74817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 29 13:03:38 devstack cinder-volume[74817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 29 13:03:38 devstack cinder-volume[74817]: INFO dbcounter [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Registered counter for database cinder
Aug 29 13:03:39 devstack cinder-volume[74817]: DEBUG oslo_db.sqlalchemy.engines [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:03:39 devstack cinder-volume[74817]: DEBUG dbcounter [-] [74817] Writer thread running {{(pid=74817) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 29 13:03:39 devstack cinder-volume[74817]: INFO cinder.rpc [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 29 13:03:39 devstack cinder-volume[74817]: INFO cinder.rpc [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 29 13:03:39 devstack cinder-volume[74817]: DEBUG oslo_db.sqlalchemy.engines [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:03:39 devstack cinder-volume[74817]: INFO cinder.volume.manager [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Determined volume DB was empty at startup.
Aug 29 13:03:39 devstack cinder-volume[74817]: DEBUG cinder.volume.manager [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74817) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 29 13:03:39 devstack cinder-volume[74817]: INFO cinder.volume.manager [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 29 13:03:39 devstack cinder-volume[74817]: WARNING stevedore.named [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 29 13:03:39 devstack cinder-volume[74817]: WARNING castellan.key_manager [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 29 13:03:39 devstack cinder-volume[74817]: WARNING cinder.keymgr.conf_key_mgr [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 29 13:03:39 devstack cinder-volume[74817]: DEBUG cinder.volume.drivers.lvm [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74817) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Aug 29 13:03:39 devstack cinder-volume[74817]: DEBUG oslo_concurrency.processutils [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_concurrency.processutils [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.445s {{(pid=74817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_db.sqlalchemy.engines [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:03:40 devstack cinder-volume[74817]: INFO cinder.rpc [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Aug 29 13:03:40 devstack cinder-volume[74817]: INFO cinder.rpc [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Aug 29 13:03:40 devstack cinder-volume[74817]: WARNING stevedore.named [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 29 13:03:40 devstack cinder-volume[74817]: WARNING castellan.key_manager [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 29 13:03:40 devstack cinder-volume[74817]: INFO cinder.volume.manager [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_db.sqlalchemy.engines [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:03:40 devstack cinder-volume[74817]: INFO oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Starting 1 workers
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Started child 74981 {{(pid=74817) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Full set of CONF: {{(pid=74817) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] ******************************************************************************** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Configuration options gathered from: {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 29 13:03:40 devstack cinder-volume[74981]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] ================================================================================ {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] allow_availability_zone_fallback = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] allow_compression_on_image_upload = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] allowed_direct_url_schemes     = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] api_rate_limit                 = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] auth_strategy                  = keystone {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] az_cache_duration              = 3600 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_availability_zone      = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_host                   = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_name                   = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_stats_polling_interval = 60 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backup_api_class               = cinder.backup.api.API {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backup_name_template           = backup-%s {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backup_use_same_host           = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backup_use_temp_snapshot       = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] chap_password                  = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] chap_username                  =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cinder_internal_tenant_project_id = c88ea4a34b9f4322a5983225eb99b2f3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cinder_internal_tenant_user_id = 7d8e6af24838434cac6832b3c87dc1cf {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cloned_volume_same_az          = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cluster                        = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] compression_format             = gzip {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] compute_api_class              = cinder.compute.nova.API {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] config_dir                     = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] config_source                  = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] control_exchange               = openstack {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] debug                          = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] default_availability_zone      = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] default_group_type             = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] default_volume_type            = lvmdriver-1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] disk_geometry                  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] driver_client_cert             = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] driver_client_cert_key         = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] driver_data_namespace          = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] driver_ssl_cert_path           = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] driver_ssl_cert_verify         = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] driver_use_ssl                 = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74981]: INFO cinder.volume.manager [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Aug 29 13:03:40 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] enable_force_upload            = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] enable_new_services            = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] enable_unsupported_driver      = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] enforce_multipath_for_image_xfer = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] filter_function                = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_api_insecure            = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_api_servers             = ['http://192.168.122.101/image'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_api_ssl_compression     = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_ca_certificates_file    = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_catalog_info            = image:glance:publicURL {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_certfile                = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_keyfile                 = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_num_retries             = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance_request_timeout         = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] goodness_function              = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] graceful_shutdown_timeout      = 5 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] group_api_class                = cinder.group.api.API {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] host                           = devstack {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_compress_on_upload       = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_conversion_address_space_limit = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_conversion_cpu_limit     = 60 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_conversion_disable       = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_upload_use_cinder_backend = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_upload_use_internal_tenant = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_volume_cache_enabled     = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_volume_cache_max_count   = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] init_host_max_objects_retrieval = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] iscsi_target_flags             =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] iscsi_write_cache              = on {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] iser_helper                    = tgtadm {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] iser_ip_address                = 192.168.122.101 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] iser_port                      = 3260 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] log_color                      = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] log_config_append              = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] log_dir                        = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] log_file                       = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] log_options                    = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] log_rotate_interval            = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] log_rotate_interval_type       = days {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] log_rotation_type              = none {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] max_age                        = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] max_logfile_count              = 30 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] max_logfile_size_mb            = 200 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] max_over_subscription_ratio    = 20.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] message_reap_interval          = 86400 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] message_ttl                    = 2592000 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] monkey_patch                   = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] monkey_patch_modules           = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] my_ip                          = 192.168.122.101 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] no_snapshot_gb_quota           = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] num_iser_scan_tries            = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] num_shell_tries                = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] num_volume_device_scan_tries   = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] nvmeof_conn_info_version       = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] nvmet_ns_id                    = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] nvmet_port_id                  = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] osapi_max_limit                = 1000 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] osapi_volume_ext_list          = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] osapi_volume_listen_port       = 8776 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] osapi_volume_use_ssl           = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] osapi_volume_workers           = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] per_volume_size_limit          = -1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] periodic_fuzzy_delay           = 60 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] periodic_interval              = 60 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] public_endpoint                = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] publish_errors                 = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] quota_backup_gigabytes         = 1000 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] quota_backups                  = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] quota_gigabytes                = 1000 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] quota_groups                   = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] quota_snapshots                = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] quota_volumes                  = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] rate_limit_burst               = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] rate_limit_except_level        = CRITICAL {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] rate_limit_interval            = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] reinit_driver_count            = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] replication_device             = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] report_discard_supported       = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] report_interval                = 120 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] reservation_clean_interval     = 86400 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] reservation_expire             = 86400 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] reserved_image_namespaces      = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] reserved_percentage            = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] rpc_response_timeout           = 120 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:40 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] run_external_periodic_tasks    = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] scst_target_driver             = iscsi {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] scst_target_iqn_name           = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_down_time              = 720 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] shell_completion               = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] snapshot_name_template         = snapshot-%s {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] snapshot_same_host             = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] split_loggers                  = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] state_path                     = /opt/stack/data/cinder {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] storage_availability_zone      = nova {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] storage_protocol               = iSCSI {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] syslog_log_facility            = LOG_USER {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] target_helper                  = lioadm {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] target_ip_address              = 192.168.122.101 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] target_port                    = 3260 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] target_protocol                = iscsi {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] target_secondary_ip_addresses  = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] trace_flags                    = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] transport_url                  = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] until_refresh                  = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] use_chap_auth                  = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] use_default_quota_class        = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] use_journal                    = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] use_json                       = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] use_multipath_for_image_xfer   = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] use_stderr                     = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] use_syslog                     = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] verify_glance_signatures       = enabled {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_api_class               = cinder.volume.api.API {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_backend_name            = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_clear                   = zero {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_clear_ionice            = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_clear_size              = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_copy_bps_limit          = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_dd_blocksize            = 1M {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_name_template           = volume-%s {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_service_inithost_offload = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volume_usage_audit_period      = month {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] zoning_mode                    = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.auth_section = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.auth_type   = password {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.auth_version = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.cache       = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.certfile    = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.insecure    = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.interface   = public {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.keyfile     = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_password = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:40 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcache_username = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.region_name = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.service_type = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.101/identity {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.backend                  = dogpile.cache.null {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.backend_argument         = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.backend_expiration_time  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.config_prefix            = cache.oslo {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.debug_cache_backend      = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.enable_retry_client      = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.enable_socket_keepalive  = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.enabled                  = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.expiration_time          = 600 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.memcache_dead_retry      = 300 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.memcache_sasl_enabled    = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.password                 = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack sudo[74985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.proxies                  = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.redis_db                 = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.redis_server             = localhost:6379 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.retry_attempts           = 2 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.retry_delay              = 0.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.socket_keepalive_count   = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.socket_keepalive_idle    = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.socket_keepalive_interval = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.socket_timeout           = 1.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.tls_allowed_ciphers      = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.tls_cafile               = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack sudo[74985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.tls_certfile             = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.tls_enabled              = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.tls_keyfile              = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cache.username                 = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] coordination.backend_url       = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.asyncio_connection    = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.asyncio_slave_connection = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.backend               = sqlalchemy {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.connection            = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.connection_debug      = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.connection_parameters =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.connection_recycle_time = 3600 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.connection_trace      = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.db_inc_retry_interval = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.db_max_retries        = 20 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.db_max_retry_interval = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.db_retry_interval     = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.max_overflow          = 50 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.max_pool_size         = 5 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.max_retries           = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.pool_timeout          = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.retry_interval        = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.slave_connection      = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.sqlite_synchronous    = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.synchronous_reader    = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] database.use_db_reconnect      = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_tracing.insecure = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.connection_string     = messaging:// {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.enabled               = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.es_doc_type           = notification {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.es_scroll_size        = 10000 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.es_scroll_time        = 2m {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.filter_error_trace    = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.hmac_keys             = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.sentinel_service_name = mymaster {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.socket_timeout        = 0.1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.trace_requests        = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler.trace_sqlalchemy      = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler_jaeger.process_tags   = {} {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] profiler_otlp.service_name_prefix = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.enforce_new_defaults = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.policy_default_rule = default {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] privsep_osbrick.group          = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] privsep_osbrick.helper_command = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] privsep_osbrick.user           = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cinder_sys_admin.group         = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cinder_sys_admin.helper_command = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] cinder_sys_admin.user          = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.auth_section      = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.auth_type         = password {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.cafile            = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.certfile          = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.collect_timing    = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.insecure          = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.keyfile           = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.send_service_user_token = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.split_loggers     = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] service_user.timeout           = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.auth_section            = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.auth_type               = password {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.certfile                = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.collect_timing          = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.insecure                = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.keyfile                 = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.region_name             = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.split_loggers           = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] glance.timeout                 = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.backend_availability_zone = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.chap_password = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.chap_username =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.disk_geometry = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.driver_client_cert = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.driver_data_namespace = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.driver_use_ssl = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.extra_capabilities = {} {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.filter_function = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.goodness_function = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.iscsi_target_flags =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.iser_helper   = tgtadm {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.iser_ip_address = 192.168.122.101 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.iser_port     = 3260 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.lvm_share_target = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.lvm_type      = auto {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.replication_device = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.report_discard_supported = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.target_helper = tgtadm {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.target_ip_address = 192.168.122.101 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.target_port   = 3260 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.target_protocol = iscsi {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.trace_flags   = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.use_chap_auth = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volume_backend_name = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volume_clear  = zero {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_reports.file_event_handler = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_reports.log_dir           = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.backend_host       = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.chap_password      = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.chap_username      = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.disk_geometry      = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.driver_client_cert = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.extra_capabilities = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.filter_function    = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.goodness_function  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.iser_helper        = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.iser_ip_address    = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.iser_port          = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.lvm_share_target   = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.lvm_type           = auto {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.num_shell_tries    = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.replication_device = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.report_discard_supported = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.reserved_percentage = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.scst_target_driver = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.storage_protocol   = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.target_helper      = lioadm {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.target_ip_address  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.target_port        = 3260 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.trace_flags        = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.use_chap_auth      = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volume_clear       = zero {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volume_clear_size  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] lvmdriver-1.volumes_dir        = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_notifications.driver = [] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] key_manager.fixed_key          = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.barbican_api_version  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.barbican_endpoint     = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.barbican_endpoint_type = public {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.barbican_region_name  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.cafile                = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.certfile              = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.collect_timing        = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.insecure              = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.keyfile               = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.number_of_retries     = 60 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.retry_delay           = 1 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.send_service_user_token = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.split_loggers         = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.timeout               = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.verify_ssl            = True {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican.verify_ssl_path       = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican_service_user.auth_section = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican_service_user.auth_type = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican_service_user.cafile   = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican_service_user.certfile = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican_service_user.collect_timing = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican_service_user.insecure = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican_service_user.keyfile  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican_service_user.split_loggers = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] barbican_service_user.timeout  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.approle_role_id          = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.approle_secret_id        = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.auth_method              = approle {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.auth_path                = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.kv_mountpoint            = secret {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.kv_path                  = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.kv_version               = 2 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.namespace                = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.root_token_id            = **** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.ssl_ca_crt_file          = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.timeout                  = 60.0 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.token_file               = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.token_role               = None {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.use_ssl                  = False {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:03:40 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] ******************************************************************************** {{(pid=74817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Aug 29 13:03:40 devstack sudo[74985]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:40 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:40 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:40 devstack sudo[75019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:03:40 devstack sudo[75019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:41 devstack sudo[75019]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.288s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:03:41 devstack cinder-volume[74981]: INFO cinder.brick.local_dev.lvm [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:41 devstack sudo[75149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:03:41 devstack sudo[75149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:41 devstack sudo[75149]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG cinder.brick.local_dev.lvm [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74981) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:41 devstack sudo[75222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:03:41 devstack sudo[75222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:41 devstack sudo[75222]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:41 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:41 devstack sudo[75419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:03:41 devstack sudo[75419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:42 devstack sudo[75419]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:42 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:42 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:42 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:42 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:42 devstack sudo[75512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Aug 29 13:03:42 devstack sudo[75512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:42 devstack sudo[75512]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:42 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.298s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:42 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:42 devstack sudo[75595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:03:42 devstack sudo[75595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:42 devstack sudo[75595]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:42 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:42 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:42 devstack sudo[75598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:03:42 devstack sudo[75598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:43 devstack sudo[75598]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:43 devstack sudo[75681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:03:43 devstack sudo[75681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:43 devstack sudo[75681]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:43 devstack sudo[75689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:03:43 devstack sudo[75689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:43 devstack sudo[75689]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:43 devstack sudo[75762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:03:43 devstack sudo[75762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:43 devstack sudo[75762]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:43 devstack cinder-volume[74981]: INFO cinder.volume.drivers.lvm [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:43 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:44 devstack sudo[75784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:03:44 devstack sudo[75784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:44 devstack sudo[75784]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:44 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:44 devstack cinder-volume[74981]: DEBUG cinder.volume.drivers.lvm [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Updating volume stats {{(pid=74981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 29 13:03:44 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:44 devstack sudo[75787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:03:44 devstack sudo[75787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:44 devstack sudo[75787]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:44 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:44 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:44 devstack sudo[75790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:03:44 devstack sudo[75790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:44 devstack sudo[75790]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:44 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:44 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:44 devstack sudo[75793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:03:44 devstack sudo[75793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:45 devstack sudo[75793]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:45 devstack sudo[75796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:03:45 devstack sudo[75796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:45 devstack sudo[75796]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:45 devstack cinder-volume[74981]: INFO cinder.volume.driver [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Driver hasn't implemented _init_vendor_properties()
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG cinder.volume.driver [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74981) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG oslo_db.sqlalchemy.engines [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74981) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG dbcounter [-] [74981] Writer thread running {{(pid=74981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG cinder.db.api [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Building query based on filter {{(pid=74981) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG cinder.image.image_utils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74981) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 29 13:03:45 devstack cinder-volume[74981]: INFO cinder.keymgr.migration [None req-4351098c-8a84-4f82-a238-a93d811482e5 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG cinder.volume.drivers.lvm [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Updating volume stats {{(pid=74981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:45 devstack sudo[75799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:03:45 devstack sudo[75799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:45 devstack sudo[75799]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:45 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:45 devstack sudo[75804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:03:45 devstack sudo[75804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:45 devstack sudo[75804]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:46 devstack sudo[75807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:03:46 devstack sudo[75807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:46 devstack sudo[75807]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:46 devstack sudo[75811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:03:46 devstack sudo[75811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:46 devstack sudo[75811]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG cinder.manager [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Notifying Schedulers of capabilities ... {{(pid=74981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:03:46 devstack cinder-volume[74981]: INFO cinder.volume.manager [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Driver initialization completed successfully.
Aug 29 13:03:46 devstack cinder-volume[74981]: INFO cinder.manager [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Initiating service 2 cleanup
Aug 29 13:03:46 devstack cinder-volume[74981]: INFO cinder.manager [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Service 2 cleanup completed.
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG cinder.service [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Creating RPC server for service cinder-volume {{(pid=74981) start /opt/stack/cinder/cinder/service.py:231}}
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG cinder.service [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74981) start /opt/stack/cinder/cinder/service.py:237}}
Aug 29 13:03:46 devstack cinder-volume[74981]: INFO cinder.volume.manager [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG cinder.volume.drivers.lvm [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Updating volume stats {{(pid=74981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:46 devstack sudo[75814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:03:46 devstack sudo[75814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:46 devstack sudo[75814]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:46 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:47 devstack sudo[75820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:03:47 devstack sudo[75820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:47 devstack sudo[75820]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:47 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:47 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:47 devstack sudo[75825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:03:47 devstack sudo[75825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:47 devstack sudo[75825]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:47 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:47 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:03:47 devstack sudo[75828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:03:47 devstack sudo[75828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:03:47 devstack sudo[75828]: pam_unix(sudo:session): session closed for user root
Aug 29 13:03:47 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:03:47 devstack cinder-volume[74981]: INFO cinder.volume.manager [None req-4d221d11-c58f-4e5f-9240-261294f82fb4 None None] Driver post RPC initialization completed successfully.
Aug 29 13:03:50 devstack cinder-volume[74817]: DEBUG dbcounter [-] [74817] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74817) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:03:53 devstack cinder-volume[74981]: DEBUG oslo_service.periodic_task [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running periodic task VolumeManager._thread_info {{(pid=74981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:03:53 devstack cinder-volume[74981]: DEBUG cinder.volume.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] thread count: 6 {{(pid=74981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:03:53 devstack cinder-volume[74981]: DEBUG cinder.volume.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] thread info: [<_MainThread(MainThread, started 133953638256768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133953527067136)>, <Thread(Thread-3 (stat_writer), started daemon 133953525565952)>, <Thread(Rabbit-heartbeat, started daemon 133953523227776)>, <Thread(Thread-5 (_runner), started daemon 133953523395648)>, <Thread(Thread-7 (_runner), started daemon 133953523444992)>] {{(pid=74981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:03:57 devstack cinder-volume[74981]: DEBUG dbcounter [-] [74981] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:03:57 devstack cinder-volume[74981]: DEBUG dbcounter [-] [74981] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=74981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:04:53 devstack cinder-volume[74981]: DEBUG oslo_service.periodic_task [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:04:53 devstack cinder-volume[74981]: DEBUG cinder.volume.drivers.lvm [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Updating volume stats {{(pid=74981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 29 13:04:53 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:04:53 devstack sudo[77881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:04:53 devstack sudo[77881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:04:54 devstack sudo[77881]: pam_unix(sudo:session): session closed for user root
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:04:54 devstack sudo[77902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:04:54 devstack sudo[77902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:04:54 devstack sudo[77902]: pam_unix(sudo:session): session closed for user root
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:04:54 devstack sudo[77905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:04:54 devstack sudo[77905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:04:54 devstack sudo[77905]: pam_unix(sudo:session): session closed for user root
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:04:54 devstack sudo[77908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:04:54 devstack sudo[77908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:04:54 devstack sudo[77908]: pam_unix(sudo:session): session closed for user root
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG cinder.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Notifying Schedulers of capabilities ... {{(pid=74981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG oslo_service.periodic_task [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running periodic task VolumeManager._thread_info {{(pid=74981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG cinder.volume.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] thread count: 6 {{(pid=74981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:04:54 devstack cinder-volume[74981]: DEBUG cinder.volume.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] thread info: [<_MainThread(MainThread, started 133953638256768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133953527067136)>, <Thread(Thread-3 (stat_writer), started daemon 133953525565952)>, <Thread(Rabbit-heartbeat, started daemon 133953523227776)>, <Thread(Thread-5 (_runner), started daemon 133953523395648)>, <Thread(Thread-7 (_runner), started daemon 133953523444992)>] {{(pid=74981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:05:53 devstack cinder-volume[74981]: DEBUG oslo_service.periodic_task [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:05:53 devstack cinder-volume[74981]: DEBUG cinder.volume.drivers.lvm [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Updating volume stats {{(pid=74981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 29 13:05:53 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:05:53 devstack sudo[81250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:05:53 devstack sudo[81250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:05:54 devstack sudo[81250]: pam_unix(sudo:session): session closed for user root
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:05:54 devstack sudo[81254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:05:54 devstack sudo[81254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:05:54 devstack sudo[81254]: pam_unix(sudo:session): session closed for user root
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:05:54 devstack sudo[81261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:05:54 devstack sudo[81261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:05:54 devstack sudo[81261]: pam_unix(sudo:session): session closed for user root
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:05:54 devstack sudo[81265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:05:54 devstack sudo[81265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:05:54 devstack sudo[81265]: pam_unix(sudo:session): session closed for user root
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG cinder.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Notifying Schedulers of capabilities ... {{(pid=74981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG oslo_service.periodic_task [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running periodic task VolumeManager._thread_info {{(pid=74981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG cinder.volume.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] thread count: 6 {{(pid=74981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:05:54 devstack cinder-volume[74981]: DEBUG cinder.volume.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] thread info: [<_MainThread(MainThread, started 133953638256768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133953527067136)>, <Thread(Thread-3 (stat_writer), started daemon 133953525565952)>, <Thread(Rabbit-heartbeat, started daemon 133953523227776)>, <Thread(Thread-5 (_runner), started daemon 133953523395648)>, <Thread(Thread-7 (_runner), started daemon 133953523444992)>] {{(pid=74981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:05:57 devstack cinder-volume[74981]: DEBUG dbcounter [-] [74981] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:06:53 devstack cinder-volume[74981]: DEBUG oslo_service.periodic_task [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:06:53 devstack cinder-volume[74981]: DEBUG cinder.volume.drivers.lvm [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Updating volume stats {{(pid=74981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 29 13:06:53 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:06:53 devstack sudo[83339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:06:53 devstack sudo[83339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:06:54 devstack sudo[83339]: pam_unix(sudo:session): session closed for user root
Aug 29 13:06:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:06:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:06:54 devstack sudo[83372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:06:54 devstack sudo[83372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:06:54 devstack sudo[83372]: pam_unix(sudo:session): session closed for user root
Aug 29 13:06:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:06:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:06:54 devstack sudo[83384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:06:54 devstack sudo[83384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:06:54 devstack sudo[83384]: pam_unix(sudo:session): session closed for user root
Aug 29 13:06:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:06:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:06:54 devstack sudo[83397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:06:54 devstack sudo[83397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:06:54 devstack sudo[83397]: pam_unix(sudo:session): session closed for user root
Aug 29 13:06:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:06:54 devstack cinder-volume[74981]: DEBUG cinder.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Notifying Schedulers of capabilities ... {{(pid=74981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:07:53 devstack cinder-volume[74981]: DEBUG oslo_service.periodic_task [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:07:53 devstack cinder-volume[74981]: DEBUG cinder.volume.drivers.lvm [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Updating volume stats {{(pid=74981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 29 13:07:53 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:07:53 devstack sudo[84573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 29 13:07:53 devstack sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:07:54 devstack sudo[84573]: pam_unix(sudo:session): session closed for user root
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:07:54 devstack sudo[84584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:07:54 devstack sudo[84584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:07:54 devstack sudo[84584]: pam_unix(sudo:session): session closed for user root
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:07:54 devstack sudo[84587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 29 13:07:54 devstack sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:07:54 devstack sudo[84587]: pam_unix(sudo:session): session closed for user root
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:07:54 devstack sudo[84593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 29 13:07:54 devstack sudo[84593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:07:54 devstack sudo[84593]: pam_unix(sudo:session): session closed for user root
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG oslo_concurrency.processutils [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=74981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG cinder.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Notifying Schedulers of capabilities ... {{(pid=74981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG oslo_service.periodic_task [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] Running periodic task VolumeManager._thread_info {{(pid=74981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG cinder.volume.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] thread count: 6 {{(pid=74981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:07:54 devstack cinder-volume[74981]: DEBUG cinder.volume.manager [None req-0b00fa53-f3dd-420a-aa72-1964bce71fa5 None None] thread info: [<_MainThread(MainThread, started 133953638256768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133953527067136)>, <Thread(Thread-3 (stat_writer), started daemon 133953525565952)>, <Thread(Rabbit-heartbeat, started daemon 133953523227776)>, <Thread(Thread-5 (_runner), started daemon 133953523395648)>, <Thread(Thread-7 (_runner), started daemon 133953523444992)>] {{(pid=74981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:07:57 devstack cinder-volume[74981]: DEBUG dbcounter [-] [74981] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:08:04 devstack cinder-volume[74817]: INFO oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Caught SIGTERM, stopping children
Aug 29 13:08:04 devstack cinder-volume[74817]: DEBUG oslo_concurrency.lockutils [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Acquiring lock "singleton_lock" {{(pid=74817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 29 13:08:04 devstack cinder-volume[74817]: DEBUG oslo_concurrency.lockutils [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Acquired lock "singleton_lock" {{(pid=74817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 29 13:08:04 devstack cinder-volume[74817]: DEBUG oslo_concurrency.lockutils [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Releasing lock "singleton_lock" {{(pid=74817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 29 13:08:04 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Stop services. {{(pid=74817) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 29 13:08:04 devstack cinder-volume[74817]: DEBUG oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Killing children. {{(pid=74817) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 29 13:08:04 devstack cinder-volume[74817]: INFO oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Waiting on 1 children to exit
Aug 29 13:08:06 devstack cinder-volume[74981]: DEBUG oslo_concurrency.lockutils [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Acquiring lock "singleton_lock" {{(pid=74981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 29 13:08:06 devstack cinder-volume[74981]: DEBUG oslo_concurrency.lockutils [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Acquired lock "singleton_lock" {{(pid=74981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 29 13:08:06 devstack cinder-volume[74981]: DEBUG oslo_concurrency.lockutils [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Releasing lock "singleton_lock" {{(pid=74981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 29 13:08:06 devstack cinder-volume[74981]: WARNING amqp [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 29 13:08:06 devstack cinder-volume[74981]: WARNING amqp [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 29 13:08:06 devstack cinder-volume[74817]: INFO oslo_service.backend._eventlet.service [None req-c2cf4aa6-a297-45ab-9f26-a98d5fc783d3 None None] Child 74981 exited with status 0
Aug 29 13:08:07 devstack cinder-volume[84939]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 29 13:08:07 devstack cinder-volume[84939]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 29 13:08:07 devstack cinder-volume[84939]: we strongly recommend against using it for new projects.
Aug 29 13:08:07 devstack cinder-volume[84939]: If you are already using Eventlet, we recommend migrating to a different
Aug 29 13:08:07 devstack cinder-volume[84939]: framework.  For more detail see
Aug 29 13:08:07 devstack cinder-volume[84939]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 29 13:08:07 devstack cinder-volume[84939]:   import eventlet  # noqa
Aug 29 13:08:09 devstack cinder-volume[84939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84939) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 29 13:08:09 devstack cinder-volume[84939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84939) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 29 13:08:09 devstack cinder-volume[84939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84939) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 29 13:08:09 devstack cinder-volume[84939]: INFO dbcounter [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Registered counter for database cinder
Aug 29 13:08:09 devstack cinder-volume[84939]: DEBUG oslo_db.sqlalchemy.engines [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84939) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG dbcounter [-] [84939] Writer thread running {{(pid=84939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 29 13:08:10 devstack cinder-volume[84939]: INFO cinder.rpc [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 29 13:08:10 devstack cinder-volume[84939]: INFO cinder.rpc [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_db.sqlalchemy.engines [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84939) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:08:10 devstack cinder-volume[84939]: INFO cinder.volume.manager [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Determined volume DB was empty at startup.
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG cinder.volume.manager [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84939) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 29 13:08:10 devstack cinder-volume[84939]: INFO cinder.volume.manager [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 29 13:08:10 devstack cinder-volume[84939]: WARNING stevedore.named [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 29 13:08:10 devstack cinder-volume[84939]: WARNING castellan.key_manager [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 29 13:08:10 devstack cinder-volume[84939]: WARNING cinder.keymgr.conf_key_mgr [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 29 13:08:10 devstack cinder-volume[84939]: INFO cinder.volume.manager [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_db.sqlalchemy.engines [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84939) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:08:10 devstack cinder-volume[84939]: INFO oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Starting 1 workers
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Started child 85186 {{(pid=84939) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Full set of CONF: {{(pid=84939) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] ******************************************************************************** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Configuration options gathered from: {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] ================================================================================ {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Aug 29 13:08:10 devstack cinder-volume[85186]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] allow_availability_zone_fallback = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] allow_compression_on_image_upload = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] allowed_direct_url_schemes     = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] api_rate_limit                 = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] auth_strategy                  = keystone {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_availability_zone      = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_host                   = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_name                   = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_stats_polling_interval = 60 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backup_api_class               = cinder.backup.api.API {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backup_name_template           = backup-%s {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backup_use_same_host           = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backup_use_temp_snapshot       = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] chap_password                  = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] chap_username                  =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cinder_internal_tenant_project_id = c88ea4a34b9f4322a5983225eb99b2f3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cinder_internal_tenant_user_id = 7d8e6af24838434cac6832b3c87dc1cf {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cluster                        = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] compression_format             = gzip {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] compute_api_class              = cinder.compute.nova.API {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] config_dir                     = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] config_source                  = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] control_exchange               = openstack {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] debug                          = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] default_availability_zone      = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] default_group_type             = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] default_volume_type            = QuobyteHD {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] disk_geometry                  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] driver_client_cert             = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] driver_client_cert_key         = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] driver_data_namespace          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] driver_ssl_cert_path           = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] driver_ssl_cert_verify         = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] driver_use_ssl                 = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] enable_new_services            = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] enable_unsupported_driver      = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] enabled_backends               = ['QuobyteHD'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] enforce_multipath_for_image_xfer = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] filter_function                = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_api_insecure            = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_api_servers             = ['http://192.168.122.101/image'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_api_ssl_compression     = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_ca_certificates_file    = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_catalog_info            = image:glance:publicURL {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_certfile                = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_keyfile                 = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_num_retries             = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance_request_timeout         = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] goodness_function              = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] graceful_shutdown_timeout      = 5 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] group_api_class                = cinder.group.api.API {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] host                           = devstack {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_compress_on_upload       = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[85186]: INFO cinder.volume.manager [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Starting volume driver QuobyteDriver (1.2.1)
Aug 29 13:08:10 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.remotefs [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85186) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_conversion_address_space_limit = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_conversion_cpu_limit     = 60 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_conversion_disable       = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_upload_use_cinder_backend = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_upload_use_internal_tenant = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_volume_cache_enabled     = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_volume_cache_max_count   = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] image_volume_cache_max_size_gb = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] init_host_max_objects_retrieval = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] instance_format                = [instance: %(uuid)s]  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] iscsi_target_flags             =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] iscsi_write_cache              = on {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] iser_helper                    = tgtadm {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] iser_ip_address                = 192.168.122.101 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] iser_port                      = 3260 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] log_color                      = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] log_config_append              = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] log_dir                        = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] log_file                       = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] log_options                    = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] log_rotate_interval            = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] log_rotate_interval_type       = days {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] log_rotation_type              = none {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] max_age                        = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] max_logfile_count              = 30 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] max_logfile_size_mb            = 200 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] max_over_subscription_ratio    = 20.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] message_reap_interval          = 86400 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] message_ttl                    = 2592000 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] migration_create_volume_timeout_secs = 300 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] monkey_patch                   = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] monkey_patch_modules           = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] my_ip                          = 192.168.122.101 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] no_snapshot_gb_quota           = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] num_iser_scan_tries            = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] num_shell_tries                = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] num_volume_device_scan_tries   = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] nvmeof_conn_info_version       = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] nvmet_ns_id                    = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] nvmet_port_id                  = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] osapi_max_limit                = 1000 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] osapi_volume_ext_list          = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] osapi_volume_listen            = 0.0.0.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] osapi_volume_listen_port       = 8776 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] osapi_volume_use_ssl           = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] osapi_volume_workers           = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] per_volume_size_limit          = -1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] periodic_fuzzy_delay           = 60 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] periodic_interval              = 60 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] project_id_regex               = [0-9a-f\-]+ {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] public_endpoint                = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] publish_errors                 = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] quota_backup_gigabytes         = 1000 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] quota_backups                  = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] quota_gigabytes                = 1000 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] quota_groups                   = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] quota_snapshots                = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] quota_volumes                  = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] rate_limit_burst               = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] rate_limit_except_level        = CRITICAL {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] rate_limit_interval            = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] reinit_driver_count            = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] replication_device             = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] report_discard_supported       = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] report_interval                = 120 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] reservation_clean_interval     = 86400 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] reservation_expire             = 86400 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] reserved_image_namespaces      = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] reserved_percentage            = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] rpc_response_timeout           = 120 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] run_external_periodic_tasks    = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] scst_target_driver             = iscsi {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] scst_target_iqn_name           = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_down_time              = 720 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] shell_completion               = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] snapshot_name_template         = snapshot-%s {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] split_loggers                  = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] state_path                     = /opt/stack/data/cinder {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] storage_availability_zone      = nova {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] storage_protocol               = iSCSI {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] syslog_log_facility            = LOG_USER {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] target_helper                  = lioadm {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] target_ip_address              = 192.168.122.101 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] target_port                    = 3260 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] target_protocol                = iscsi {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] target_secondary_ip_addresses  = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] trace_flags                    = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] transfer_api_class             = cinder.transfer.api.API {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] transport_url                  = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] until_refresh                  = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] use_chap_auth                  = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] use_default_quota_class        = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] use_journal                    = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] use_json                       = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] use_multipath_for_image_xfer   = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] use_stderr                     = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] use_syslog                     = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] verify_glance_signatures       = enabled {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_api_class               = cinder.volume.api.API {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_backend_name            = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_clear                   = zero {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_clear_ionice            = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_clear_size              = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_copy_bps_limit          = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_dd_blocksize            = 1M {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_name_template           = volume-%s {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_service_inithost_offload = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volume_usage_audit_period      = month {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] zoning_mode                    = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_concurrency.disable_process_locking = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85186) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Aug 29 13:08:10 devstack cinder-volume[85186]: WARNING cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 29 13:08:10 devstack cinder-volume[85186]: WARNING cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 29 13:08:10 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Running cmd (subprocess): mount.quobyte {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.auth_section = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.auth_type   = password {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.auth_version = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.cache       = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.certfile    = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.delay_auth_decision = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.http_connect_timeout = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.include_service_catalog = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.insecure    = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.interface   = public {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.keyfile     = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_password = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcache_username = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.region_name = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.service_token_roles_required = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.service_type = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.token_cache_time = 300 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.101/identity {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.backend                  = dogpile.cache.null {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.backend_argument         = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.backend_expiration_time  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.config_prefix            = cache.oslo {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.debug_cache_backend      = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.enable_retry_client      = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.enable_socket_keepalive  = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.enabled                  = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.expiration_time          = 600 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.hashclient_retry_attempts = 2 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.memcache_dead_retry      = 300 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.memcache_pool_maxsize    = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.memcache_sasl_enabled    = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.password                 = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.proxies                  = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.redis_db                 = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.redis_sentinel_service_name = mymaster {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.redis_server             = localhost:6379 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.retry_attempts           = 2 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.retry_delay              = 0.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.socket_keepalive_count   = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.socket_keepalive_idle    = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.socket_keepalive_interval = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.socket_timeout           = 1.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.tls_allowed_ciphers      = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.tls_cafile               = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.tls_certfile             = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.tls_enabled              = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.tls_keyfile              = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cache.username                 = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] coordination.backend_url       = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.asyncio_connection    = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.asyncio_slave_connection = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.backend               = sqlalchemy {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.connection            = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.connection_debug      = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.connection_parameters =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.connection_recycle_time = 3600 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.connection_trace      = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.db_inc_retry_interval = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.db_max_retries        = 20 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.db_max_retry_interval = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.db_retry_interval     = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.max_overflow          = 50 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.max_pool_size         = 5 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.max_retries           = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.mysql_wsrep_sync_wait = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.pool_timeout          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.retry_interval        = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.slave_connection      = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.sqlite_synchronous    = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.synchronous_reader    = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] database.use_db_reconnect      = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_tracing.insecure = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.connection_string     = messaging:// {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.enabled               = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.es_doc_type           = notification {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.es_scroll_size        = 10000 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.es_scroll_time        = 2m {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.filter_error_trace    = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.hmac_keys             = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.sentinel_service_name = mymaster {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.socket_timeout        = 0.1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.trace_requests        = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler.trace_sqlalchemy      = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler_jaeger.process_tags   = {} {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler_jaeger.service_name_prefix = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] profiler_otlp.service_name_prefix = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.enforce_new_defaults = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.policy_default_rule = default {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.policy_file        = policy.yaml {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_policy.remote_timeout     = 60.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] privsep_osbrick.group          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack quobyte-client[85192]: Reading configuration file: /etc/quobyte/client.cfg
Aug 29 13:08:10 devstack quobyte-client[85192]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] privsep_osbrick.helper_command = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] CMD "mount.quobyte" returned: 1 in 0.098s {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] privsep_osbrick.user           = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:08:10 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85186) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[85186]: INFO cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e ...
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cinder_sys_admin.group         = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cinder_sys_admin.helper_command = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] cinder_sys_admin.user          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.auth_section      = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.auth_type         = password {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.cafile            = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 -c /etc/quobyte/client-cinder.cfg {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.certfile          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.collect_timing    = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.insecure          = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.keyfile           = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.send_service_user_token = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.split_loggers     = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] service_user.timeout           = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.auth_section            = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.auth_type               = password {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.certfile                = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.collect_timing          = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.insecure                = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.keyfile                 = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.region_name             = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.split_loggers           = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] glance.timeout                 = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.backend_availability_zone = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.chap_password = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.chap_username =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.disk_geometry = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.driver_client_cert = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.driver_client_cert_key = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.driver_data_namespace = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.driver_use_ssl = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.enable_unsupported_driver = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.extra_capabilities = {} {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.filter_function = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.goodness_function = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.iscsi_target_flags =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.iscsi_write_cache = on {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.iser_helper   = tgtadm {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.iser_ip_address = 192.168.122.101 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.iser_port     = 3260 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_host      =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_login     = admin {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_mount_options = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_password  = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_private_key =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_share_path =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_ssh_port  = 22 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.num_shell_tries = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.nvmet_port_id = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.quobyte_client_cfg = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack sudo[85194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 -c /etc/quobyte/client-cinder.cfg
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.quobyte_volume_url = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.replication_device = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.report_discard_supported = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.reserved_percentage = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.scst_target_driver = iscsi {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.scst_target_iqn_name = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.storage_protocol = iSCSI {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.target_helper = tgtadm {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.target_ip_address = 192.168.122.101 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.target_port   = 3260 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.target_protocol = iscsi {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.trace_flags   = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.unique_fqdn_network = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.use_chap_auth = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.volume_backend_name = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.volume_clear  = zero {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.volume_clear_ionice = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.volume_clear_size = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_reports.file_event_handler = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_reports.log_dir           = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.backend_availability_zone = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.backend_host         = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.chap_password        = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.chap_username        = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.chiscsi_conf         = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:10 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.disk_geometry        = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.driver_client_cert   = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.driver_client_cert_key = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.driver_data_namespace = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.driver_use_ssl       = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.extra_capabilities   = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.filter_function      = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.goodness_function    = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.iscsi_target_flags   = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.iscsi_write_cache    = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.iser_helper          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.iser_ip_address      = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.iser_port            = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.iser_target_prefix   = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_host             = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_login            = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_mount_options    = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_password         = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_private_key      = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_share_path       = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_ssh_port         = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.num_shell_tries      = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nvmet_ns_id          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.nvmet_port_id        = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.replication_device   = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.report_discard_supported = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.reserved_percentage  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.scst_target_driver   = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.storage_protocol     = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.target_helper        = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.target_ip_address    = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.target_port          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.target_prefix        = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.target_protocol      = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.trace_flags          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.unique_fqdn_network  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.use_chap_auth        = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.volume_clear         = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.volume_clear_ionice  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.volume_clear_size    = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] QuobyteHD.volumes_dir          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.ssl      = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.ssl_version =  {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_notifications.driver = [] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_notifications.retry = -1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] oslo_messaging_notifications.transport_url = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] key_manager.fixed_key          = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.barbican_api_version  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.barbican_endpoint     = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.barbican_endpoint_type = public {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.barbican_region_name  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.cafile                = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.certfile              = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.collect_timing        = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.insecure              = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.keyfile               = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.number_of_retries     = 60 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.retry_delay           = 1 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.send_service_user_token = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.split_loggers         = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.timeout               = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.verify_ssl            = True {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican.verify_ssl_path       = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican_service_user.auth_section = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican_service_user.auth_type = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican_service_user.cafile   = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican_service_user.certfile = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican_service_user.collect_timing = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican_service_user.insecure = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican_service_user.keyfile  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican_service_user.split_loggers = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] barbican_service_user.timeout  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.approle_role_id          = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.approle_secret_id        = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.auth_method              = approle {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.auth_path                = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.kv_mountpoint            = secret {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.kv_path                  = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.kv_version               = 2 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.namespace                = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.root_token_id            = **** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.ssl_ca_crt_file          = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.timeout                  = 60.0 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.token_file               = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.token_role               = None {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.use_ssl                  = False {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:11 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] ******************************************************************************** {{(pid=84939) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Aug 29 13:08:11 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.461s {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:11 devstack cinder-volume[85186]: INFO cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e succeeded
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85186) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.474s {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:11 devstack sudo[85263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:08:11 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:08:11 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.240s {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:11 devstack cinder-volume[85186]: INFO cinder.volume.driver [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Driver hasn't implemented _init_vendor_properties()
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG cinder.volume.driver [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5325202941895, 'free_capacity_gb': 1774.5325202941895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85186) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG oslo_db.sqlalchemy.engines [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85186) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG dbcounter [-] [85186] Writer thread running {{(pid=85186) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG cinder.db.api [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Building query based on filter {{(pid=85186) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG cinder.image.image_utils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85186) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 29 13:08:11 devstack cinder-volume[85186]: INFO cinder.keymgr.migration [None req-82f46de7-d42d-42ce-a92e-da5cc81656c0 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85186) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85186) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:08:11 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:11 devstack sudo[85266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:08:11 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:08:12 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.239s {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG cinder.manager [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Notifying Schedulers of capabilities ... {{(pid=85186) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:08:12 devstack cinder-volume[85186]: INFO cinder.volume.manager [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Driver initialization completed successfully.
Aug 29 13:08:12 devstack cinder-volume[85186]: INFO cinder.manager [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Initiating service 3 cleanup
Aug 29 13:08:12 devstack cinder-volume[85186]: INFO cinder.manager [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Service 3 cleanup completed.
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG cinder.service [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Creating RPC server for service cinder-volume {{(pid=85186) start /opt/stack/cinder/cinder/service.py:231}}
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG cinder.service [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85186) start /opt/stack/cinder/cinder/service.py:237}}
Aug 29 13:08:12 devstack cinder-volume[85186]: INFO cinder.volume.manager [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85186) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.quobyte [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85186) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:12 devstack sudo[85270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:08:12 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:08:12 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root
Aug 29 13:08:12 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.251s {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:12 devstack cinder-volume[85186]: INFO cinder.volume.manager [None req-edc74904-494c-4d31-a9bd-7261d157b4fc None None] Driver post RPC initialization completed successfully.
Aug 29 13:08:16 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-89fdfdd3-3bd8-4293-8f39-30c83e73f41e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:08:16 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-89fdfdd3-3bd8-4293-8f39-30c83e73f41e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:08:16 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.quobyte [None req-89fdfdd3-3bd8-4293-8f39-30c83e73f41e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85186) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:08:16 devstack cinder-volume[85186]: DEBUG cinder.volume.drivers.quobyte [None req-89fdfdd3-3bd8-4293-8f39-30c83e73f41e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85186) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:08:16 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-89fdfdd3-3bd8-4293-8f39-30c83e73f41e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:08:16 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-89fdfdd3-3bd8-4293-8f39-30c83e73f41e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:16 devstack sudo[85417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:08:16 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:08:17 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root
Aug 29 13:08:17 devstack cinder-volume[85186]: DEBUG oslo_concurrency.processutils [None req-89fdfdd3-3bd8-4293-8f39-30c83e73f41e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.243s {{(pid=85186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:17 devstack cinder-volume[85186]: DEBUG cinder.manager [None req-89fdfdd3-3bd8-4293-8f39-30c83e73f41e None None] Notifying Schedulers of capabilities ... {{(pid=85186) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:08:17 devstack cinder-volume[84939]: INFO oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Caught SIGTERM, stopping children
Aug 29 13:08:17 devstack cinder-volume[84939]: DEBUG oslo_concurrency.lockutils [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Acquiring lock "singleton_lock" {{(pid=84939) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 29 13:08:17 devstack cinder-volume[84939]: DEBUG oslo_concurrency.lockutils [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Acquired lock "singleton_lock" {{(pid=84939) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 29 13:08:17 devstack cinder-volume[84939]: DEBUG oslo_concurrency.lockutils [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Releasing lock "singleton_lock" {{(pid=84939) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 29 13:08:17 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Stop services. {{(pid=84939) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 29 13:08:17 devstack cinder-volume[84939]: DEBUG oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Killing children. {{(pid=84939) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 29 13:08:17 devstack cinder-volume[84939]: INFO oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Waiting on 1 children to exit
Aug 29 13:08:20 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Acquiring lock "singleton_lock" {{(pid=85186) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 29 13:08:20 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Acquired lock "singleton_lock" {{(pid=85186) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 29 13:08:20 devstack cinder-volume[85186]: DEBUG oslo_concurrency.lockutils [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Releasing lock "singleton_lock" {{(pid=85186) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 29 13:08:20 devstack cinder-volume[85186]: WARNING amqp [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 29 13:08:20 devstack cinder-volume[85186]: WARNING amqp [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 29 13:08:20 devstack cinder-volume[84939]: INFO oslo_service.backend._eventlet.service [None req-7dd51f6e-ff39-407a-8e6b-77641a7711eb None None] Child 85186 exited with status 0
Aug 29 13:08:21 devstack cinder-volume[85470]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 29 13:08:21 devstack cinder-volume[85470]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 29 13:08:21 devstack cinder-volume[85470]: we strongly recommend against using it for new projects.
Aug 29 13:08:21 devstack cinder-volume[85470]: If you are already using Eventlet, we recommend migrating to a different
Aug 29 13:08:21 devstack cinder-volume[85470]: framework.  For more detail see
Aug 29 13:08:21 devstack cinder-volume[85470]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 29 13:08:21 devstack cinder-volume[85470]:   import eventlet  # noqa
Aug 29 13:08:24 devstack cinder-volume[85470]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 29 13:08:24 devstack cinder-volume[85470]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 29 13:08:24 devstack cinder-volume[85470]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 29 13:08:24 devstack cinder-volume[85470]: INFO dbcounter [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Registered counter for database cinder
Aug 29 13:08:24 devstack cinder-volume[85470]: DEBUG oslo_db.sqlalchemy.engines [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG dbcounter [-] [85470] Writer thread running {{(pid=85470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 29 13:08:25 devstack cinder-volume[85470]: INFO cinder.rpc [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 29 13:08:25 devstack cinder-volume[85470]: INFO cinder.rpc [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_db.sqlalchemy.engines [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:08:25 devstack cinder-volume[85470]: INFO cinder.volume.manager [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Determined volume DB was empty at startup.
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG cinder.volume.manager [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85470) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 29 13:08:25 devstack cinder-volume[85470]: WARNING stevedore.named [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 29 13:08:25 devstack cinder-volume[85470]: WARNING castellan.key_manager [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 29 13:08:25 devstack cinder-volume[85470]: WARNING cinder.keymgr.conf_key_mgr [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 29 13:08:25 devstack cinder-volume[85470]: INFO cinder.volume.manager [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_db.sqlalchemy.engines [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:08:25 devstack cinder-volume[85470]: INFO oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Starting 1 workers
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Started child 85771 {{(pid=85470) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Full set of CONF: {{(pid=85470) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] ******************************************************************************** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] Configuration options gathered from: {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] ================================================================================ {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] allow_availability_zone_fallback = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] allow_compression_on_image_upload = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] allowed_direct_url_schemes     = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] api_rate_limit                 = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] auth_strategy                  = keystone {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_availability_zone      = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_host                   = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_name                   = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_stats_polling_interval = 60 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backup_api_class               = cinder.backup.api.API {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backup_name_template           = backup-%s {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85771]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backup_use_same_host           = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backup_use_temp_snapshot       = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] chap_password                  = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] chap_username                  =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cinder_internal_tenant_project_id = c88ea4a34b9f4322a5983225eb99b2f3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cinder_internal_tenant_user_id = 7d8e6af24838434cac6832b3c87dc1cf {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cluster                        = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] compression_format             = gzip {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] compute_api_class              = cinder.compute.nova.API {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] config_dir                     = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] config_source                  = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] control_exchange               = openstack {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] debug                          = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] default_availability_zone      = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] default_group_type             = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] default_volume_type            = QuobyteHD {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] disk_geometry                  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] driver_client_cert             = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] driver_client_cert_key         = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] driver_data_namespace          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] driver_ssl_cert_path           = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] driver_ssl_cert_verify         = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] driver_use_ssl                 = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] enable_new_services            = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] enable_unsupported_driver      = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] enabled_backends               = ['QuobyteHD'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] enforce_multipath_for_image_xfer = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] filter_function                = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_api_insecure            = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_api_servers             = ['http://192.168.122.101/image'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_api_ssl_compression     = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_ca_certificates_file    = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_catalog_info            = image:glance:publicURL {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_certfile                = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_keyfile                 = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_num_retries             = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance_request_timeout         = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] goodness_function              = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] graceful_shutdown_timeout      = 5 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] group_api_class                = cinder.group.api.API {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] host                           = devstack {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_compress_on_upload       = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_conversion_address_space_limit = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_conversion_cpu_limit     = 60 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_conversion_disable       = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_upload_use_cinder_backend = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_upload_use_internal_tenant = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_volume_cache_enabled     = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_volume_cache_max_count   = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] image_volume_cache_max_size_gb = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] init_host_max_objects_retrieval = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] instance_format                = [instance: %(uuid)s]  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] iscsi_target_flags             =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] iscsi_write_cache              = on {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] iser_helper                    = tgtadm {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] iser_ip_address                = 192.168.122.101 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] iser_port                      = 3260 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] log_color                      = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] log_config_append              = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] log_dir                        = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] log_file                       = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] log_options                    = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] log_rotate_interval            = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] log_rotate_interval_type       = days {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] log_rotation_type              = none {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] max_age                        = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] max_logfile_count              = 30 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] max_logfile_size_mb            = 200 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] max_over_subscription_ratio    = 20.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] message_reap_interval          = 86400 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] message_ttl                    = 2592000 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] migration_create_volume_timeout_secs = 300 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] monkey_patch                   = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] monkey_patch_modules           = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] my_ip                          = 192.168.122.101 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] no_snapshot_gb_quota           = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] num_iser_scan_tries            = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] num_shell_tries                = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] num_volume_device_scan_tries   = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] nvmeof_conn_info_version       = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] nvmet_ns_id                    = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] nvmet_port_id                  = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] osapi_max_limit                = 1000 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] osapi_volume_ext_list          = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] osapi_volume_listen_port       = 8776 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] osapi_volume_use_ssl           = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] osapi_volume_workers           = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] per_volume_size_limit          = -1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] periodic_fuzzy_delay           = 60 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] periodic_interval              = 60 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] public_endpoint                = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] publish_errors                 = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] quota_backup_gigabytes         = 1000 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] quota_backups                  = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] quota_gigabytes                = 1000 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] quota_groups                   = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] quota_snapshots                = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] quota_volumes                  = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] rate_limit_burst               = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] rate_limit_except_level        = CRITICAL {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] rate_limit_interval            = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Starting volume driver QuobyteDriver (1.2.1)
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] reinit_driver_count            = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] replication_device             = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85771) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] report_discard_supported       = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] report_interval                = 120 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] reservation_clean_interval     = 86400 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] reservation_expire             = 86400 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] reserved_image_namespaces      = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] reserved_percentage            = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] rpc_response_timeout           = 120 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] run_external_periodic_tasks    = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] scst_target_driver             = iscsi {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] scst_target_iqn_name           = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_down_time              = 720 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] shell_completion               = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] snapshot_name_template         = snapshot-%s {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] split_loggers                  = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] state_path                     = /opt/stack/data/cinder {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] storage_availability_zone      = nova {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] storage_protocol               = iSCSI {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] syslog_log_facility            = LOG_USER {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] target_helper                  = lioadm {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] target_ip_address              = 192.168.122.101 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] target_port                    = 3260 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] target_protocol                = iscsi {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] target_secondary_ip_addresses  = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] trace_flags                    = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] transport_url                  = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] until_refresh                  = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] use_chap_auth                  = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] use_default_quota_class        = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] use_journal                    = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] use_json                       = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] use_multipath_for_image_xfer   = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] use_stderr                     = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] use_syslog                     = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] verify_glance_signatures       = enabled {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_api_class               = cinder.volume.api.API {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_backend_name            = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_clear                   = zero {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_clear_ionice            = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_clear_size              = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_copy_bps_limit          = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_dd_blocksize            = 1M {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_name_template           = volume-%s {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_service_inithost_offload = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volume_usage_audit_period      = month {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] zoning_mode                    = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_concurrency.disable_process_locking = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.auth_section = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.auth_type   = password {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.auth_version = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.cache       = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.certfile    = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.delay_auth_decision = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.http_connect_timeout = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.include_service_catalog = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.insecure    = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.interface   = public {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.keyfile     = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_password = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcache_username = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.region_name = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.service_token_roles_required = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.service_type = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.token_cache_time = 300 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.101/identity {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.backend                  = dogpile.cache.null {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.backend_argument         = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.backend_expiration_time  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.config_prefix            = cache.oslo {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.debug_cache_backend      = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.enable_retry_client      = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.enable_socket_keepalive  = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.enabled                  = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.expiration_time          = 600 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.hashclient_retry_attempts = 2 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.memcache_dead_retry      = 300 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.memcache_pool_maxsize    = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.memcache_sasl_enabled    = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.password                 = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.proxies                  = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.redis_db                 = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.redis_sentinel_service_name = mymaster {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.redis_server             = localhost:6379 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.retry_attempts           = 2 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.retry_delay              = 0.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.socket_keepalive_count   = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.socket_keepalive_idle    = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.socket_keepalive_interval = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.socket_timeout           = 1.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.tls_allowed_ciphers      = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.tls_cafile               = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.tls_certfile             = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.tls_enabled              = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.tls_keyfile              = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85771) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cache.username                 = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] coordination.backend_url       = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.asyncio_connection    = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.asyncio_slave_connection = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.backend               = sqlalchemy {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.connection            = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.connection_debug      = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.quobyte [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.connection_parameters =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.connection_recycle_time = 3600 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.quobyte [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.connection_trace      = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.db_inc_retry_interval = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.db_max_retries        = 20 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.db_max_retry_interval = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.db_retry_interval     = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.max_overflow          = 50 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.max_pool_size         = 5 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.max_retries           = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Running cmd (subprocess): mount.quobyte {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.mysql_wsrep_sync_wait = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.pool_timeout          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.retry_interval        = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.slave_connection      = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.sqlite_synchronous    = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.synchronous_reader    = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] database.use_db_reconnect      = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_tracing.insecure = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.connection_string     = messaging:// {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.enabled               = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.es_doc_type           = notification {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.es_scroll_size        = 10000 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.es_scroll_time        = 2m {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.filter_error_trace    = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.hmac_keys             = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.sentinel_service_name = mymaster {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.socket_timeout        = 0.1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.trace_requests        = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler.trace_sqlalchemy      = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler_jaeger.process_tags   = {} {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler_jaeger.service_name_prefix = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] profiler_otlp.service_name_prefix = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.enforce_new_defaults = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.policy_default_rule = default {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.policy_file        = policy.yaml {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] privsep_osbrick.group          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] privsep_osbrick.helper_command = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] privsep_osbrick.user           = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cinder_sys_admin.group         = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cinder_sys_admin.helper_command = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] cinder_sys_admin.user          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.auth_section      = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.auth_type         = password {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.cafile            = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.certfile          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.collect_timing    = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.insecure          = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.keyfile           = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.send_service_user_token = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.split_loggers     = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] service_user.timeout           = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.auth_section            = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.auth_type               = password {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.certfile                = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.collect_timing          = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.insecure                = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.keyfile                 = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.region_name             = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.split_loggers           = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] glance.timeout                 = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.backend_availability_zone = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.chap_password = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.chap_username =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.disk_geometry = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.driver_client_cert = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.driver_client_cert_key = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.driver_data_namespace = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.driver_use_ssl = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.enable_unsupported_driver = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.extra_capabilities = {} {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.filter_function = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.goodness_function = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.iscsi_target_flags =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.iscsi_write_cache = on {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.iser_helper   = tgtadm {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.iser_ip_address = 192.168.122.101 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.iser_port     = 3260 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_host      =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_login     = admin {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_mount_options = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_password  = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_private_key =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_share_path =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.num_shell_tries = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.nvmet_port_id = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.quobyte_client_cfg = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.quobyte_volume_url = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.replication_device = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.report_discard_supported = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.reserved_percentage = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.scst_target_driver = iscsi {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.scst_target_iqn_name = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.storage_protocol = iSCSI {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.target_helper = tgtadm {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.target_ip_address = 192.168.122.101 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.target_port   = 3260 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.target_protocol = iscsi {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.trace_flags   = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.unique_fqdn_network = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.use_chap_auth = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.volume_backend_name = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.volume_clear  = zero {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.volume_clear_ionice = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.volume_clear_size = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack quobyte-client[85772]: Reading configuration file: /etc/quobyte/client.cfg
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_reports.file_event_handler = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_reports.log_dir           = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.backend_availability_zone = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack quobyte-client[85772]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.backend_host         = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.chap_password        = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.chap_username        = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.chiscsi_conf         = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.disk_geometry        = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.driver_client_cert   = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.driver_client_cert_key = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.driver_data_namespace = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.driver_use_ssl       = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.extra_capabilities   = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.filter_function      = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.goodness_function    = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.iser_helper          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.iser_ip_address      = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.iser_port            = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.iser_target_prefix   = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_host             = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_login            = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_mount_options    = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_password         = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_private_key      = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_share_path       = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_ssh_port         = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.num_shell_tries      = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.nvmet_port_id        = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.replication_device   = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.report_discard_supported = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.reserved_percentage  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.scst_target_driver   = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.storage_protocol     = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.target_helper        = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.target_ip_address    = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.target_port          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.target_prefix        = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.target_protocol      = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.trace_flags          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.use_chap_auth        = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.volume_clear         = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.volume_clear_size    = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] QuobyteHD.volumes_dir          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.ssl      = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_notifications.driver = [] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_notifications.retry = -1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] oslo_messaging_notifications.transport_url = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] key_manager.fixed_key          = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.barbican_api_version  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.barbican_endpoint     = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.barbican_endpoint_type = public {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.barbican_region_name  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.cafile                = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.certfile              = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.collect_timing        = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.insecure              = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.keyfile               = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.number_of_retries     = 60 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.retry_delay           = 1 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.send_service_user_token = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack sudo[85773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.split_loggers         = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.timeout               = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.verify_ssl            = True {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican.verify_ssl_path       = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican_service_user.auth_section = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican_service_user.auth_type = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican_service_user.cafile   = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican_service_user.certfile = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican_service_user.collect_timing = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican_service_user.insecure = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican_service_user.keyfile  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican_service_user.split_loggers = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] barbican_service_user.timeout  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.approle_role_id          = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.approle_secret_id        = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.auth_method              = approle {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.auth_path                = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.kv_mountpoint            = secret {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.kv_path                  = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.kv_version               = 2 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.namespace                = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.root_token_id            = **** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.ssl_ca_crt_file          = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.timeout                  = 60.0 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.token_file               = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.token_role               = None {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.use_ssl                  = False {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 29 13:08:25 devstack cinder-volume[85470]: DEBUG oslo_service.backend._eventlet.service [None req-572b1c20-d8ee-4ce4-ab5a-38bbd49b8d2b None None] ******************************************************************************** {{(pid=85470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Aug 29 13:08:25 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.250s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:25 devstack cinder-volume[85771]: INFO cinder.volume.driver [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Driver hasn't implemented _init_vendor_properties()
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG cinder.volume.driver [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5325202941895, 'free_capacity_gb': 1774.5325202941895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85771) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_db.sqlalchemy.engines [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85771) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writer thread running {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG cinder.db.api [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Building query based on filter {{(pid=85771) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85771) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:08:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:25 devstack cinder-volume[85771]: INFO cinder.keymgr.migration [None req-5224bc6e-1f5a-4abf-86d0-c8efb688bb70 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 29 13:08:25 devstack sudo[85784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:08:25 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:08:26 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.234s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:08:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Driver initialization completed successfully.
Aug 29 13:08:26 devstack cinder-volume[85771]: INFO cinder.manager [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Initiating service 3 cleanup
Aug 29 13:08:26 devstack cinder-volume[85771]: INFO cinder.manager [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Service 3 cleanup completed.
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG cinder.service [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Creating RPC server for service cinder-volume {{(pid=85771) start /opt/stack/cinder/cinder/service.py:231}}
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG cinder.service [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85771) start /opt/stack/cinder/cinder/service.py:237}}
Aug 29 13:08:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:08:26 devstack sudo[85797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:08:26 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:08:26 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root
Aug 29 13:08:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.243s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:08:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ba4ee0a3-eafa-4a7e-8253-8f90a8ee71ff None None] Driver post RPC initialization completed successfully.
Aug 29 13:08:35 devstack cinder-volume[85470]: DEBUG dbcounter [-] [85470] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:08:36 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=3 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:08:36 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:08:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:08:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 6 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:08:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Flow 'volume_create_manager' (3e62d999-ef36-46b1-9474-73a9fae6eaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abafed0d-5806-42b5-9705-a6abacb14f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abafed0d-5806-42b5-9705-a6abacb14f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1322774534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7cfb6cf4598546969b398b51fc5e8714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:09:25Z,use_quota=True,user_id='0898de4acc0047a8ae285ad39b5fd1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48e4c08-7524-421e-8b14-5afc29d7d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48e4c08-7524-421e-8b14-5afc29d7d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8709fcaa-468c-4e08-ab39-751c71fc1032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8709fcaa-468c-4e08-ab39-751c71fc1032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3', 'volume_name': 'volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa280597-911f-4af0-8cf8-0eb2bc940af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa280597-911f-4af0-8cf8-0eb2bc940af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2254aa-f646-4ac9-9e3d-8c9727dcc15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:25 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Volume 6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3', 'volume_size': 1}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1322774534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7cfb6cf4598546969b398b51fc5e8714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:09:25Z,use_quota=True,user_id='0898de4acc0047a8ae285ad39b5fd1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Creating volume 6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:09:25 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:09:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:25 devstack sudo[86387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3 1073741824
Aug 29 13:09:25 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:26 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3 1073741824" returned: 0 in 1.337s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:26 devstack sudo[86749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3
Aug 29 13:09:26 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:27 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3" returned: 0 in 0.484s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:09:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:09:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2254aa-f646-4ac9-9e3d-8c9727dcc15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96aaf39-cb06-46e1-8711-eeb8db5bcaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:27 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Volume volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3 (6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3): created successfully
Aug 29 13:09:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96aaf39-cb06-46e1-8711-eeb8db5bcaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Flow 'volume_create_manager' (3e62d999-ef36-46b1-9474-73a9fae6eaf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:09:27 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-3e52c904-6f19-4897-a2a0-0cb917b83595 req-1543c6a6-321e-4776-a14d-00f95ebfba32 tempest-VolumesGetTestJSON-1889076231 None] Created volume successfully.
Aug 29 13:09:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Acquiring lock "cinder-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:09:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Lock "cinder-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:09:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Acquiring lock "cinder-quobyte-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:09:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Lock "cinder-quobyte-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3" acquired by "delete_volume" :: waited 0.042s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:09:29 devstack cinder-volume[85771]: INFO oslo.privsep.daemon [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz3xparl1/privsep.sock']
Aug 29 13:09:29 devstack sudo[86788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz3xparl1/privsep.sock
Aug 29 13:09:29 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:31 devstack cinder-volume[85771]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Aug 29 13:09:31 devstack cinder-volume[85771]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 29 13:09:31 devstack cinder-volume[85771]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Aug 29 13:09:31 devstack cinder-volume[85771]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 29 13:09:31 devstack cinder-volume[85771]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Aug 29 13:09:31 devstack cinder-volume[85771]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Aug 29 13:09:31 devstack cinder-volume[85771]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 29 13:09:31 devstack cinder-volume[85771]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 29 13:09:31 devstack cinder-volume[85771]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Aug 29 13:09:31 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:31 devstack cinder-volume[85771]: INFO oslo.privsep.daemon [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Spawned new privsep daemon via rootwrap
Aug 29 13:09:31 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Accepted privsep connection to /tmp/tmpz3xparl1/privsep.sock {{(pid=85771) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Aug 29 13:09:31 devstack cinder-volume[85771]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 29 13:09:31 devstack cinder-volume[85771]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 29 13:09:31 devstack cinder-volume[85771]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 29 13:09:31 devstack cinder-volume[85771]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86801
Aug 29 13:09:31 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3b5188-6092-4d58-a8f1-07373ab16673]: (2,) {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:09:31 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[973713e7-9451-45f3-b68a-bd82e67bc1eb]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:09:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:31 devstack sudo[86804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3
Aug 29 13:09:31 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:32 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3" returned: 0 in 0.684s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:32 devstack sudo[86827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3
Aug 29 13:09:32 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:32 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3" returned: 0 in 0.371s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Lock "cinder-quobyte-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3" released by "delete_volume" :: held 3.429s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:09:32 devstack cinder-volume[85771]: WARNING cinder.quota [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:09:32 devstack cinder-volume[85771]: WARNING cinder.quota [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG cinder.quota [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Created reservations ['3c162333-fb25-4434-bac7-4d0489c25a39', 'fe7eaef1-eee3-42a5-965a-6d61aa4fd346', '71c93d58-986f-4a43-8390-fb4200b05120', 'fe637871-0d19-4584-b48b-810b9151ee9c'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:09:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:32 devstack sudo[86848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:09:32 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:33 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.334s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:33 devstack cinder-volume[85771]: DEBUG cinder.manager [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:09:33 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Deleted volume successfully.
Aug 29 13:09:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-8163b349-6244-4f13-8d99-77c4f2d0a1fd req-bd4c5013-5e71-46fa-87b1-2c6011552d38 tempest-VolumesGetTestJSON-1889076231 None] Lock "cinder-6d1f9e74-f41a-4b35-b0a4-006bbe4d65e3-delete_volume" released by "delete_volume" :: held 4.185s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Flow 'volume_create_manager' (9678c763-9e7b-45b9-8132-08f9879756b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2ba649-16dd-496b-9cf9-8fa10e9c6d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2ba649-16dd-496b-9cf9-8fa10e9c6d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-38976822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0587704c-24d7-4915-a8f1-4bf4264d4d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902bf53745c54a24b8b098f9e31681d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:09:39Z,use_quota=True,user_id='cb5db6732ff144c5af5c134cdd99daf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efcff20-408b-44a4-8731-d9a0ed814b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efcff20-408b-44a4-8731-d9a0ed814b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27cc223-b2ad-429e-a695-f7b0acce1b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27cc223-b2ad-429e-a695-f7b0acce1b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0587704c-24d7-4915-a8f1-4bf4264d4d1a', 'volume_name': 'volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf595976-92a4-4850-9890-1804bbe29fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf595976-92a4-4850-9890-1804bbe29fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4381aa0-bb12-4bc9-9059-d55fc13320f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:39 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Volume 0587704c-24d7-4915-a8f1-4bf4264d4d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a', 'volume_size': 1}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-38976822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0587704c-24d7-4915-a8f1-4bf4264d4d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902bf53745c54a24b8b098f9e31681d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:09:39Z,use_quota=True,user_id='cb5db6732ff144c5af5c134cdd99daf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Creating volume 0587704c-24d7-4915-a8f1-4bf4264d4d1a {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:09:39 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:09:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:39 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a 1073741824
Aug 29 13:09:39 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:40 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a 1073741824" returned: 0 in 1.249s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:40 devstack sudo[86956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a
Aug 29 13:09:40 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:41 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a" returned: 0 in 0.426s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:09:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:09:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4381aa0-bb12-4bc9-9059-d55fc13320f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acddeb2c-f4c5-47ac-8bc3-95c7765a7a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:41 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Volume volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a (0587704c-24d7-4915-a8f1-4bf4264d4d1a): created successfully
Aug 29 13:09:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acddeb2c-f4c5-47ac-8bc3-95c7765a7a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Flow 'volume_create_manager' (9678c763-9e7b-45b9-8132-08f9879756b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:09:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c9a3ea4e-79a8-4b56-925f-4771cd5981c7 tempest-ServerRescueNegativeTestJSON-477876884 None] Created volume successfully.
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Flow 'volume_create_manager' (ff73e1d7-781d-4f65-b770-c3b8182493e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c308f5-a799-45b3-a78f-c21226962479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c308f5-a799-45b3-a78f-c21226962479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1543718390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1580f0-e02d-4941-baad-155f66e42691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf1b5b48bd6401ebf880592c79c4527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:09:45Z,use_quota=True,user_id='2f371e5414f84ff2b30ecca7dc9e347e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc9ad33-41a0-4e4d-b0eb-89616476e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc9ad33-41a0-4e4d-b0eb-89616476e607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ddfed1-aaa9-4e38-b40b-b0bea8a69f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ddfed1-aaa9-4e38-b40b-b0bea8a69f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1580f0-e02d-4941-baad-155f66e42691', 'volume_name': 'volume-6b1580f0-e02d-4941-baad-155f66e42691', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dca2ea-62a7-4349-8ba7-5db5a14f88e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dca2ea-62a7-4349-8ba7-5db5a14f88e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f270d627-21f6-4e92-8a9c-0fc98e548708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:45 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Volume 6b1580f0-e02d-4941-baad-155f66e42691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1580f0-e02d-4941-baad-155f66e42691', 'volume_size': 1}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1543718390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1580f0-e02d-4941-baad-155f66e42691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf1b5b48bd6401ebf880592c79c4527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:09:45Z,use_quota=True,user_id='2f371e5414f84ff2b30ecca7dc9e347e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Creating volume 6b1580f0-e02d-4941-baad-155f66e42691 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:09:45 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:09:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:45 devstack sudo[86976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691 1073741824
Aug 29 13:09:45 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:46 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691 1073741824" returned: 0 in 0.989s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:46 devstack sudo[87004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691
Aug 29 13:09:46 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:47 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691" returned: 0 in 0.774s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:09:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:09:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f270d627-21f6-4e92-8a9c-0fc98e548708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1580f0-e02d-4941-baad-155f66e42691', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92612fc7-1fbd-4d7b-ae40-fa53a45330a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:09:47 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Volume volume-6b1580f0-e02d-4941-baad-155f66e42691 (6b1580f0-e02d-4941-baad-155f66e42691): created successfully
Aug 29 13:09:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92612fc7-1fbd-4d7b-ae40-fa53a45330a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:09:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Flow 'volume_create_manager' (ff73e1d7-781d-4f65-b770-c3b8182493e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:09:47 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-bbe920b7-0f40-4bb8-82b6-e7facdf398d5 tempest-VolumesAdminNegativeTest-630835157 None] Created volume successfully.
Aug 29 13:09:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Acquiring lock "cinder-6b1580f0-e02d-4941-baad-155f66e42691-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:09:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Lock "cinder-6b1580f0-e02d-4941-baad-155f66e42691-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:09:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Acquiring lock "cinder-quobyte-6b1580f0-e02d-4941-baad-155f66e42691" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:09:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Lock "cinder-quobyte-6b1580f0-e02d-4941-baad-155f66e42691" acquired by "delete_volume" :: waited 0.048s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:09:50 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a13222-b0af-4c2a-ad62-3a86f4a9168e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:09:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:50 devstack sudo[87010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691
Aug 29 13:09:50 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:50 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691" returned: 0 in 0.575s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:50 devstack sudo[87016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691
Aug 29 13:09:50 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:51 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6b1580f0-e02d-4941-baad-155f66e42691" returned: 0 in 0.750s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Lock "cinder-quobyte-6b1580f0-e02d-4941-baad-155f66e42691" released by "delete_volume" :: held 1.414s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:09:51 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Created reservations ['2f2c79b5-c697-4d23-8343-da4d931fd428', 'df56eee1-46e6-4296-be4f-e87206ddec13', '60d63e10-dd73-452d-bf18-825e3f949ed4', 'b540408b-9951-4326-a0e7-9d2bcaad69d4'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:09:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:09:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:09:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:09:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:09:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:09:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:51 devstack sudo[87030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:09:51 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:52 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.621s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:52 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:09:52 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Deleted volume successfully.
Aug 29 13:09:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24e9789-7dfe-4057-9978-c2e680c7f667 tempest-VolumesAdminNegativeTest-630835157 None] Lock "cinder-6b1580f0-e02d-4941-baad-155f66e42691-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:09:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:09:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:09:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:09:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:09:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:09:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:09:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:54 devstack sudo[87071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:09:54 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:09:55 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root
Aug 29 13:09:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.725s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:09:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:09:55 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:09:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 8 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:09:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:09:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Acquiring lock "cinder-0587704c-24d7-4915-a8f1-4bf4264d4d1a-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:09:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "cinder-0587704c-24d7-4915-a8f1-4bf4264d4d1a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:09:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Acquiring lock "cinder-quobyte-0587704c-24d7-4915-a8f1-4bf4264d4d1a" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:09:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "cinder-quobyte-0587704c-24d7-4915-a8f1-4bf4264d4d1a" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:09:59 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d6b41f-eb6f-4b29-9d7d-d760b9b8a182]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:09:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:09:59 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a
Aug 29 13:09:59 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:00 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a" returned: 0 in 0.702s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:00 devstack sudo[87109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a
Aug 29 13:10:00 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:00 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0587704c-24d7-4915-a8f1-4bf4264d4d1a" returned: 0 in 0.449s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "cinder-quobyte-0587704c-24d7-4915-a8f1-4bf4264d4d1a" released by "delete_volume" :: held 1.232s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Created reservations ['e7780b92-a086-4472-a010-7bc02f64cc0d', '98f7f222-721f-4905-8f5b-0e7c5183a7c3', 'b6729871-4f39-4fe6-a69e-035846cbc831', '04ab1347-5322-4f34-a686-f99c328d451f'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:01 devstack sudo[87112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:10:01 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:01 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.448s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:01 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:10:01 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Deleted volume successfully.
Aug 29 13:10:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c5e7a48-1b66-41b3-8a7a-603d2cb82704 tempest-ServerRescueNegativeTestJSON-477876884 None] Lock "cinder-0587704c-24d7-4915-a8f1-4bf4264d4d1a-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:10:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-35207c2c-1495-40a5-b334-8341df46483d tempest-GroupsV320Test-95821595 None] Group tempest-GroupsV320Test-Group-1072885339: creating
Aug 29 13:10:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-35207c2c-1495-40a5-b334-8341df46483d tempest-GroupsV320Test-95821595 None] Group tempest-GroupsV320Test-Group-1072885339: created successfully
Aug 29 13:10:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-35207c2c-1495-40a5-b334-8341df46483d tempest-GroupsV320Test-95821595 None] Create group completed successfully.
Aug 29 13:10:07 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] Created reservations ['c4dbba1f-a4e8-49a4-98c1-ba8a0c00e307'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:10:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:10:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:10:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:07 devstack sudo[87173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:10:07 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:07 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.264s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:07 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:10:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-40adf05c-13b4-4709-bfcf-1941eed1565b tempest-GroupsV320Test-95821595 None] Delete group completed successfully.
Aug 29 13:10:17 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=28,cinder:UPDATE=41,cinder:DELETE=3,cinder:INSERT=9 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:10:17 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=32,cinder:SELECT=27,cinder:INSERT=7,cinder:DELETE=3 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Flow 'volume_create_manager' (a00df863-76f4-42e5-9214-d542730cd2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5037c3ad-da70-46d9-aa46-a17187c2cb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5037c3ad-da70-46d9-aa46-a17187c2cb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1691171239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89be408e-b25d-4abb-bcfe-e7fb11d65eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b4f29d7e5244f09ba3f531a56a577d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:10:21Z,use_quota=True,user_id='9293b6e5f1914f76b18251907ac1c77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(141a3d6c-adf2-429f-89f6-2b154a2d6524),volume_type_id=141a3d6c-adf2-429f-89f6-2b154a2d6524)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb58d3d-e9f6-4f5c-858c-af6815db3143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb58d3d-e9f6-4f5c-858c-af6815db3143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dae9dcc-fb0d-463f-bcb8-3f7d3b340fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dae9dcc-fb0d-463f-bcb8-3f7d3b340fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89be408e-b25d-4abb-bcfe-e7fb11d65eba', 'volume_name': 'volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dc2ea6-5afb-4add-8582-5e543aedcae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dc2ea6-5afb-4add-8582-5e543aedcae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692263a1-0bee-4cf7-9315-6cea8e833289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:20 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Volume 89be408e-b25d-4abb-bcfe-e7fb11d65eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba', 'volume_size': 1}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1691171239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89be408e-b25d-4abb-bcfe-e7fb11d65eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b4f29d7e5244f09ba3f531a56a577d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:10:21Z,use_quota=True,user_id='9293b6e5f1914f76b18251907ac1c77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(141a3d6c-adf2-429f-89f6-2b154a2d6524),volume_type_id=141a3d6c-adf2-429f-89f6-2b154a2d6524)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Creating volume 89be408e-b25d-4abb-bcfe-e7fb11d65eba {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:10:20 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:10:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:20 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba 1073741824
Aug 29 13:10:20 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:21 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba 1073741824" returned: 0 in 0.609s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:21 devstack sudo[87236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba
Aug 29 13:10:21 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:21 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba" returned: 0 in 0.313s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:10:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692263a1-0bee-4cf7-9315-6cea8e833289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f851e1-146b-4bb9-ba6c-44cc9bfaaf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:21 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Volume volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba (89be408e-b25d-4abb-bcfe-e7fb11d65eba): created successfully
Aug 29 13:10:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f851e1-146b-4bb9-ba6c-44cc9bfaaf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Flow 'volume_create_manager' (a00df863-76f4-42e5-9214-d542730cd2b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:10:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ae7507e5-032a-4d94-b415-4e09a142776f tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Created volume successfully.
Aug 29 13:10:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-62b92031-f4d4-4c4e-9d32-44e20d34b9d6 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-62b92031-f4d4-4c4e-9d32-44e20d34b9d6 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-62b92031-f4d4-4c4e-9d32-44e20d34b9d6 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:10:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-62b92031-f4d4-4c4e-9d32-44e20d34b9d6 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:10:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-62b92031-f4d4-4c4e-9d32-44e20d34b9d6 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-62b92031-f4d4-4c4e-9d32-44e20d34b9d6 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:23 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:10:23 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:24 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-62b92031-f4d4-4c4e-9d32-44e20d34b9d6 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.307s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:24 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-62b92031-f4d4-4c4e-9d32-44e20d34b9d6 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:10:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-62b92031-f4d4-4c4e-9d32-44e20d34b9d6 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Retype volume completed successfully.
Aug 29 13:10:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Acquiring lock "cinder-89be408e-b25d-4abb-bcfe-e7fb11d65eba-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:10:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "cinder-89be408e-b25d-4abb-bcfe-e7fb11d65eba-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:10:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Acquiring lock "cinder-quobyte-89be408e-b25d-4abb-bcfe-e7fb11d65eba" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:10:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "cinder-quobyte-89be408e-b25d-4abb-bcfe-e7fb11d65eba" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:10:25 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c134b4dc-123f-4abf-81fd-197a9731f371]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:10:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:25 devstack sudo[87258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba
Aug 29 13:10:25 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:25 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba" returned: 0 in 0.613s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:25 devstack sudo[87272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba
Aug 29 13:10:25 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:26 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-89be408e-b25d-4abb-bcfe-e7fb11d65eba" returned: 0 in 0.322s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "cinder-quobyte-89be408e-b25d-4abb-bcfe-e7fb11d65eba" released by "delete_volume" :: held 1.001s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:10:26 devstack cinder-volume[85771]: WARNING cinder.quota [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:10:26 devstack cinder-volume[85771]: WARNING cinder.quota [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Created reservations ['bea85208-5a30-4bb7-8c0f-7a4b66f50e77', '31ca7bd5-9906-488a-a58e-54d9d970406c', '950f409c-6ce9-4b72-bfff-20142d6806ca', 'e5e09f39-cc04-49b6-ba48-64d88071a6c7'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:26 devstack sudo[87280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:10:26 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:26 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.461s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:10:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Deleted volume successfully.
Aug 29 13:10:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1cfbb2a4-34ac-4321-a2c9-78d784d2faa4 tempest-VolumeRetypeWithoutMigrationTest-131733897 None] Lock "cinder-89be408e-b25d-4abb-bcfe-e7fb11d65eba-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:10:36 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=12,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:10:36 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=14,cinder:SELECT=17,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Flow 'volume_create_manager' (d377f811-27b9-428c-a400-6eb8b791a6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de38164-2dfe-4f3f-9bc1-4a2d7b63a33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de38164-2dfe-4f3f-9bc1-4a2d7b63a33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2096870524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40393489-8332-443f-8b2e-72ef0ac3f9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20daa8d236f848fe944d01213096147c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:10:40Z,use_quota=True,user_id='31b76ed87244430fad9254a23a8fe74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0378589d-2a4e-45dc-a0ed-54b16c536a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0378589d-2a4e-45dc-a0ed-54b16c536a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7718a7a0-abeb-4b0a-bfcd-b6e40e10abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7718a7a0-abeb-4b0a-bfcd-b6e40e10abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40393489-8332-443f-8b2e-72ef0ac3f9dc', 'volume_name': 'volume-40393489-8332-443f-8b2e-72ef0ac3f9dc', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69d8e1f-4681-4e0a-b13d-ac68f79736a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69d8e1f-4681-4e0a-b13d-ac68f79736a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abd635d-9e7f-4852-b39d-ca094088b0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:40 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Volume 40393489-8332-443f-8b2e-72ef0ac3f9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40393489-8332-443f-8b2e-72ef0ac3f9dc', 'volume_size': 1}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2096870524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40393489-8332-443f-8b2e-72ef0ac3f9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20daa8d236f848fe944d01213096147c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:10:40Z,use_quota=True,user_id='31b76ed87244430fad9254a23a8fe74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Creating volume 40393489-8332-443f-8b2e-72ef0ac3f9dc {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:10:40 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:40 devstack sudo[87365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc 1073741824
Aug 29 13:10:40 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:40 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc 1073741824" returned: 0 in 0.554s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:41 devstack sudo[87371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc
Aug 29 13:10:41 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:41 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc" returned: 0 in 0.455s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:10:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abd635d-9e7f-4852-b39d-ca094088b0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40393489-8332-443f-8b2e-72ef0ac3f9dc', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb0fd6a-31c4-48da-8187-1a503d1c536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:41 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Volume volume-40393489-8332-443f-8b2e-72ef0ac3f9dc (40393489-8332-443f-8b2e-72ef0ac3f9dc): created successfully
Aug 29 13:10:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb0fd6a-31c4-48da-8187-1a503d1c536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Flow 'volume_create_manager' (d377f811-27b9-428c-a400-6eb8b791a6ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:10:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9eb29834-954d-407b-a716-d2dc774473c9 tempest-VolumesServicesTestJSON-708969713 None] Created volume successfully.
Aug 29 13:10:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Acquiring lock "cinder-40393489-8332-443f-8b2e-72ef0ac3f9dc-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:10:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Lock "cinder-40393489-8332-443f-8b2e-72ef0ac3f9dc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:10:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Acquiring lock "cinder-quobyte-40393489-8332-443f-8b2e-72ef0ac3f9dc" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:10:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Lock "cinder-quobyte-40393489-8332-443f-8b2e-72ef0ac3f9dc" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:10:42 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c3b22a-a6b4-48fa-a931-b6dfb6f65e0b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:10:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:43 devstack sudo[87375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc
Aug 29 13:10:43 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:43 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc" returned: 0 in 0.572s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:43 devstack sudo[87381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc
Aug 29 13:10:43 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:44 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40393489-8332-443f-8b2e-72ef0ac3f9dc" returned: 0 in 0.526s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Lock "cinder-quobyte-40393489-8332-443f-8b2e-72ef0ac3f9dc" released by "delete_volume" :: held 1.162s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Created reservations ['f8f8b5ac-3566-4030-8c8d-c32852520d67', 'a8cc09d6-4f04-417b-955a-e51161da6d5d', '61407a5d-20d2-4369-9ea8-c1905b855ab9', 'f5960cd3-ce0f-4cf3-8c48-6a0326cfb511'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:44 devstack sudo[87387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:10:44 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:44 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.309s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:10:44 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Deleted volume successfully.
Aug 29 13:10:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a0a41dd-65f2-4940-9d56-00cee733cb43 tempest-VolumesServicesTestJSON-708969713 None] Lock "cinder-40393489-8332-443f-8b2e-72ef0ac3f9dc-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:10:54 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:10:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:10:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:10:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:10:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:54 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=10,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=2 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:10:54 devstack sudo[87586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:10:54 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:55 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 1.123s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Flow 'volume_create_manager' (b510ef9d-0d3d-439f-b213-9758ae55cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68ba7e8-aeac-4909-ac05-15f4534e1458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68ba7e8-aeac-4909-ac05-15f4534e1458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-817769794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf1d751-9300-4328-9647-f69ab5be055e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb174f05f824d2b9eaa77887d5fbd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:10:58Z,use_quota=True,user_id='c5580ef63952470db4c2f24e063f42ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7895cb-f70c-4c33-84b8-a861d21bff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7895cb-f70c-4c33-84b8-a861d21bff07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dca63c-60f2-4b66-a77b-141b1b8d5042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dca63c-60f2-4b66-a77b-141b1b8d5042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf1d751-9300-4328-9647-f69ab5be055e', 'volume_name': 'volume-ccf1d751-9300-4328-9647-f69ab5be055e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7ba7ca-b634-4190-a0c6-37dfbf80b82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7ba7ca-b634-4190-a0c6-37dfbf80b82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e87258-e7f4-40e4-bd19-548bd82bf087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:10:58 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Volume ccf1d751-9300-4328-9647-f69ab5be055e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf1d751-9300-4328-9647-f69ab5be055e', 'volume_size': 1}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-817769794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf1d751-9300-4328-9647-f69ab5be055e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb174f05f824d2b9eaa77887d5fbd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:10:58Z,use_quota=True,user_id='c5580ef63952470db4c2f24e063f42ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Creating volume ccf1d751-9300-4328-9647-f69ab5be055e {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:10:58 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:10:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:58 devstack sudo[87609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e 1073741824
Aug 29 13:10:58 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:59 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e 1073741824" returned: 0 in 0.642s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:10:59 devstack sudo[87615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e
Aug 29 13:10:59 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:10:59 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root
Aug 29 13:10:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e" returned: 0 in 0.547s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:10:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:10:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:10:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e87258-e7f4-40e4-bd19-548bd82bf087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf1d751-9300-4328-9647-f69ab5be055e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:10:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99b924a-50ce-4530-b572-0608a3fd45c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:00 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Volume volume-ccf1d751-9300-4328-9647-f69ab5be055e (ccf1d751-9300-4328-9647-f69ab5be055e): created successfully
Aug 29 13:11:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99b924a-50ce-4530-b572-0608a3fd45c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Flow 'volume_create_manager' (b510ef9d-0d3d-439f-b213-9758ae55cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:11:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fff25102-d68c-48e0-ab71-93bd5a6f2e2b tempest-DeleteServersTestJSON-925087627 None] Created volume successfully.
Aug 29 13:11:05 devstack cinder-volume[85771]: WARNING py.warnings [req-8435d25b-f85a-484d-a008-b09641c0c81e req-1b761883-28fa-4bb9-8adf-fc017acc8020 tempest-DeleteServersTestJSON-925087627 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Aug 29 13:11:05 devstack cinder-volume[85771]:   .first()
Aug 29 13:11:05 devstack cinder-volume[85771]: 
Aug 29 13:11:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-8435d25b-f85a-484d-a008-b09641c0c81e req-1b761883-28fa-4bb9-8adf-fc017acc8020 tempest-DeleteServersTestJSON-925087627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-8435d25b-f85a-484d-a008-b09641c0c81e req-1b761883-28fa-4bb9-8adf-fc017acc8020 tempest-DeleteServersTestJSON-925087627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-8435d25b-f85a-484d-a008-b09641c0c81e req-1b761883-28fa-4bb9-8adf-fc017acc8020 tempest-DeleteServersTestJSON-925087627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-8435d25b-f85a-484d-a008-b09641c0c81e req-1b761883-28fa-4bb9-8adf-fc017acc8020 tempest-DeleteServersTestJSON-925087627 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-ccf1d751-9300-4328-9647-f69ab5be055e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8882f4f2-74cb-4903-86fc-0ffdf59c668a', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:11:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-8435d25b-f85a-484d-a008-b09641c0c81e req-1b761883-28fa-4bb9-8adf-fc017acc8020 tempest-DeleteServersTestJSON-925087627 None] attachment_update completed successfully.
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Flow 'volume_create_manager' (277a6472-914a-46d5-b92a-63844f9c62d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8739ada-8616-4338-93f2-f036bc58362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8739ada-8616-4338-93f2-f036bc58362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1316722569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6483c99f-7eac-4f88-bc68-85484509e468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09da69ecb5b34e28adbc6ab51cf0a2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:11:07Z,use_quota=True,user_id='d8c0389300c14cf4882094dadbdb16e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3587f54a-81da-4ac1-89ac-9ad1a9e16727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3587f54a-81da-4ac1-89ac-9ad1a9e16727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91409fa3-25a0-445d-a449-0f9ed212ec6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91409fa3-25a0-445d-a449-0f9ed212ec6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6483c99f-7eac-4f88-bc68-85484509e468', 'volume_name': 'volume-6483c99f-7eac-4f88-bc68-85484509e468', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9ff7c8-610d-40c2-a8ac-a7e5eec5732c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9ff7c8-610d-40c2-a8ac-a7e5eec5732c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbf990a-4ed5-489f-b17a-66f4fefdd99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:07 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Volume 6483c99f-7eac-4f88-bc68-85484509e468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6483c99f-7eac-4f88-bc68-85484509e468', 'volume_size': 1}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1316722569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6483c99f-7eac-4f88-bc68-85484509e468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09da69ecb5b34e28adbc6ab51cf0a2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:11:07Z,use_quota=True,user_id='d8c0389300c14cf4882094dadbdb16e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Creating volume 6483c99f-7eac-4f88-bc68-85484509e468 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:11:07 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:11:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:07 devstack sudo[88030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468 1073741824
Aug 29 13:11:07 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:08 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468 1073741824" returned: 0 in 1.064s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:08 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468
Aug 29 13:11:08 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:09 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468" returned: 0 in 0.597s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:11:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbf990a-4ed5-489f-b17a-66f4fefdd99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6483c99f-7eac-4f88-bc68-85484509e468', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a3fbdf-b83b-4953-ade2-fb9b9274de59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:09 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Volume volume-6483c99f-7eac-4f88-bc68-85484509e468 (6483c99f-7eac-4f88-bc68-85484509e468): created successfully
Aug 29 13:11:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a3fbdf-b83b-4953-ade2-fb9b9274de59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Flow 'volume_create_manager' (277a6472-914a-46d5-b92a-63844f9c62d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:11:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-98ff2455-6416-4918-b703-d98af5ca6732 tempest-ServerActionsTestOtherA-452165374 None] Created volume successfully.
Aug 29 13:11:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-e5213097-8321-4de3-a6d4-db302ec2aabc req-3d0fa060-4dc4-465c-8932-5481e375ac5f tempest-DeleteServersTestJSON-925087627 None] Terminate volume connection completed successfully.
Aug 29 13:11:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-e5213097-8321-4de3-a6d4-db302ec2aabc req-3d0fa060-4dc4-465c-8932-5481e375ac5f tempest-DeleteServersTestJSON-925087627 None] Deleting attachment 8882f4f2-74cb-4903-86fc-0ffdf59c668a. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:11:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Acquiring lock "cinder-ccf1d751-9300-4328-9647-f69ab5be055e-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:11:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Lock "cinder-ccf1d751-9300-4328-9647-f69ab5be055e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:11:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Acquiring lock "cinder-quobyte-ccf1d751-9300-4328-9647-f69ab5be055e" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:11:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Lock "cinder-quobyte-ccf1d751-9300-4328-9647-f69ab5be055e" acquired by "delete_volume" :: waited 0.037s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:11:12 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[40318243-3456-4820-be95-cd2439a0a210]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:11:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:12 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e
Aug 29 13:11:12 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:12 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e" returned: 0 in 0.411s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:12 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e
Aug 29 13:11:12 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:13 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ccf1d751-9300-4328-9647-f69ab5be055e" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Lock "cinder-quobyte-ccf1d751-9300-4328-9647-f69ab5be055e" released by "delete_volume" :: held 0.747s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Created reservations ['d4efe19f-36df-4ff3-8651-d55160c74390', 'b0f0184f-dde4-4f02-8883-096ff16bae94', '17898198-aab1-4aa8-9b98-5a78555e765c', 'db126e0c-ff62-4f9d-ae50-12c037e04d10'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:13 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:11:13 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:13 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.342s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:11:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Deleted volume successfully.
Aug 29 13:11:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-56b3fb12-7d6f-4ac3-8b07-8b73a9d56cd9 tempest-DeleteServersTestJSON-925087627 None] Lock "cinder-ccf1d751-9300-4328-9647-f69ab5be055e-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Flow 'volume_create_manager' (33c1677b-08d9-46ee-a48d-195b7ac9ec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6998d9a-8b78-4cf8-ad85-27a8931bbd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6998d9a-8b78-4cf8-ad85-27a8931bbd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1532739336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892ad205-c29b-4394-8c6e-c123abf619b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7325a4347b39498fa3253f6d2c101fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:11:23Z,use_quota=True,user_id='da109bda0fe94b61b4c1b1f494016741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adc8675-a8f9-4cd7-bcce-72969b9915f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adc8675-a8f9-4cd7-bcce-72969b9915f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ec7d97-f5f2-4fb5-aff5-7e90f95fdb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ec7d97-f5f2-4fb5-aff5-7e90f95fdb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '892ad205-c29b-4394-8c6e-c123abf619b9', 'volume_name': 'volume-892ad205-c29b-4394-8c6e-c123abf619b9', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f7bc75-ed3d-447b-9ac9-5f517f9fee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f7bc75-ed3d-447b-9ac9-5f517f9fee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2463bd97-491b-4074-b828-e174d3c3fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:22 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Volume 892ad205-c29b-4394-8c6e-c123abf619b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-892ad205-c29b-4394-8c6e-c123abf619b9', 'volume_size': 1}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1532739336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892ad205-c29b-4394-8c6e-c123abf619b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7325a4347b39498fa3253f6d2c101fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:11:23Z,use_quota=True,user_id='da109bda0fe94b61b4c1b1f494016741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:11:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Creating volume 892ad205-c29b-4394-8c6e-c123abf619b9 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:11:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:11:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:11:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:11:23 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:11:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:23 devstack sudo[88238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9 1073741824
Aug 29 13:11:23 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:23 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9 1073741824" returned: 0 in 0.881s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:23 devstack sudo[88263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9
Aug 29 13:11:24 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:24 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9" returned: 0 in 0.313s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:11:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2463bd97-491b-4074-b828-e174d3c3fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892ad205-c29b-4394-8c6e-c123abf619b9', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5726ce6-16d5-4e30-b17c-617613566efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:24 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Volume volume-892ad205-c29b-4394-8c6e-c123abf619b9 (892ad205-c29b-4394-8c6e-c123abf619b9): created successfully
Aug 29 13:11:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5726ce6-16d5-4e30-b17c-617613566efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Flow 'volume_create_manager' (33c1677b-08d9-46ee-a48d-195b7ac9ec7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:11:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2ad8b4d1-f412-4810-bdbc-6db831d0c7e9 tempest-AttachVolumeNegativeTest-583345777 None] Created volume successfully.
Aug 29 13:11:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-cccfad19-8e2f-4e51-8b03-6f862e919855 req-c2119f5a-ebd6-4ad4-b5c0-9787209f519e tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-cccfad19-8e2f-4e51-8b03-6f862e919855 req-c2119f5a-ebd6-4ad4-b5c0-9787209f519e tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-cccfad19-8e2f-4e51-8b03-6f862e919855 req-c2119f5a-ebd6-4ad4-b5c0-9787209f519e tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-cccfad19-8e2f-4e51-8b03-6f862e919855 req-c2119f5a-ebd6-4ad4-b5c0-9787209f519e tempest-AttachVolumeNegativeTest-583345777 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-892ad205-c29b-4394-8c6e-c123abf619b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70398f73-757c-4e11-995d-147a593e09dd', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:11:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-cccfad19-8e2f-4e51-8b03-6f862e919855 req-c2119f5a-ebd6-4ad4-b5c0-9787209f519e tempest-AttachVolumeNegativeTest-583345777 None] attachment_update completed successfully.
Aug 29 13:11:35 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=19,cinder:SELECT=26,cinder:INSERT=5,cinder:DELETE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:11:35 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=24,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=2 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:11:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-ea777002-c167-4e0d-aabb-afa14eba9d4e req-76389e66-79a9-47f4-b135-7cc096f9c8ca tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-ea777002-c167-4e0d-aabb-afa14eba9d4e req-76389e66-79a9-47f4-b135-7cc096f9c8ca tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-ea777002-c167-4e0d-aabb-afa14eba9d4e req-76389e66-79a9-47f4-b135-7cc096f9c8ca tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-ea777002-c167-4e0d-aabb-afa14eba9d4e req-76389e66-79a9-47f4-b135-7cc096f9c8ca tempest-ServerActionsTestOtherA-452165374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-6483c99f-7eac-4f88-bc68-85484509e468', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '499e3aa0-9b98-4186-b7a0-eb1613f8d22a', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:11:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-ea777002-c167-4e0d-aabb-afa14eba9d4e req-76389e66-79a9-47f4-b135-7cc096f9c8ca tempest-ServerActionsTestOtherA-452165374 None] attachment_update completed successfully.
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:54 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:11:54 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:54 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.355s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 8 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:11:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Flow 'volume_create_manager' (fe0d7a66-e0d0-4075-8d41-7f5eb7880dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cb3fbd-53e3-4fad-a7e3-456b2d0767af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cb3fbd-53e3-4fad-a7e3-456b2d0767af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2069368617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606b87b1-f4a9-47ab-93bb-d897497f9452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07eecc250c1140c4a9b4101e5dae9b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:11:57Z,use_quota=True,user_id='6ea841c3bec14e0d8263dd760cb4c870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cf33c6-fa25-45a3-912d-a3b319966aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cf33c6-fa25-45a3-912d-a3b319966aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859eb526-bcdb-4a8e-abd6-434de8306bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859eb526-bcdb-4a8e-abd6-434de8306bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '606b87b1-f4a9-47ab-93bb-d897497f9452', 'volume_name': 'volume-606b87b1-f4a9-47ab-93bb-d897497f9452', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e0ada8-eed5-4015-b82e-8bc8c61874f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e0ada8-eed5-4015-b82e-8bc8c61874f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3404e709-e31f-4eeb-872f-4bd31c4ce154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:57 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Volume 606b87b1-f4a9-47ab-93bb-d897497f9452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-606b87b1-f4a9-47ab-93bb-d897497f9452', 'volume_size': 1}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2069368617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606b87b1-f4a9-47ab-93bb-d897497f9452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07eecc250c1140c4a9b4101e5dae9b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:11:57Z,use_quota=True,user_id='6ea841c3bec14e0d8263dd760cb4c870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Creating volume 606b87b1-f4a9-47ab-93bb-d897497f9452 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:11:57 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:11:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:57 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452 1073741824
Aug 29 13:11:57 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:58 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452 1073741824" returned: 0 in 0.894s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:11:58 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452
Aug 29 13:11:58 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:11:59 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Aug 29 13:11:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452" returned: 0 in 0.540s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:11:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:11:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:11:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3404e709-e31f-4eeb-872f-4bd31c4ce154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-606b87b1-f4a9-47ab-93bb-d897497f9452', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8d2e23-54a7-4f23-9ccc-b905862869f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:11:59 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Volume volume-606b87b1-f4a9-47ab-93bb-d897497f9452 (606b87b1-f4a9-47ab-93bb-d897497f9452): created successfully
Aug 29 13:11:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8d2e23-54a7-4f23-9ccc-b905862869f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:11:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Flow 'volume_create_manager' (fe0d7a66-e0d0-4075-8d41-7f5eb7880dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:11:59 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7c3e200a-a09c-4c1a-8499-2022fbb03c2b tempest-TaggedAttachmentsTest-283506461 None] Created volume successfully.
Aug 29 13:11:59 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-2c2a2143-145f-4053-a0fb-ca49fa82ac26 req-0f5a2787-d140-489b-997c-52ee9f480013 tempest-ServerActionsTestOtherA-452165374 None] Terminate volume connection completed successfully.
Aug 29 13:11:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-2c2a2143-145f-4053-a0fb-ca49fa82ac26 req-0f5a2787-d140-489b-997c-52ee9f480013 tempest-ServerActionsTestOtherA-452165374 None] Deleting attachment 499e3aa0-9b98-4186-b7a0-eb1613f8d22a. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:12:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-2c2a2143-145f-4053-a0fb-ca49fa82ac26 req-7973c30f-49a5-4ce0-8a21-5f7c851cc26f tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-2c2a2143-145f-4053-a0fb-ca49fa82ac26 req-7973c30f-49a5-4ce0-8a21-5f7c851cc26f tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-2c2a2143-145f-4053-a0fb-ca49fa82ac26 req-7973c30f-49a5-4ce0-8a21-5f7c851cc26f tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-2c2a2143-145f-4053-a0fb-ca49fa82ac26 req-7973c30f-49a5-4ce0-8a21-5f7c851cc26f tempest-ServerActionsTestOtherA-452165374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-6483c99f-7eac-4f88-bc68-85484509e468', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c93faf0c-067c-4dac-8d40-e1de9605ca94', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:12:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-2c2a2143-145f-4053-a0fb-ca49fa82ac26 req-7973c30f-49a5-4ce0-8a21-5f7c851cc26f tempest-ServerActionsTestOtherA-452165374 None] attachment_update completed successfully.
Aug 29 13:12:08 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:12:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (a6a0a6fd-fbfd-4222-be5c-2fbacee22132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358c3675-be0c-45b9-9795-fca31348259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358c3675-be0c-45b9-9795-fca31348259a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323596988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09152c4-1407-4905-b828-e0574a02346b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:09Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72971bbc-f599-441d-b1b2-61311442fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72971bbc-f599-441d-b1b2-61311442fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28005136-36a4-4b45-95f9-c9939b20deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28005136-36a4-4b45-95f9-c9939b20deb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09152c4-1407-4905-b828-e0574a02346b', 'volume_name': 'volume-c09152c4-1407-4905-b828-e0574a02346b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bd6e63-5c9d-4975-acd6-69ecf14bcba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bd6e63-5c9d-4975-acd6-69ecf14bcba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a7717a-3941-4708-8e2a-13c8e3231522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:09 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Volume c09152c4-1407-4905-b828-e0574a02346b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09152c4-1407-4905-b828-e0574a02346b', 'volume_size': 1}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323596988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09152c4-1407-4905-b828-e0574a02346b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:09Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Creating volume c09152c4-1407-4905-b828-e0574a02346b {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:12:09 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:12:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:09 devstack sudo[89033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b 1073741824
Aug 29 13:12:09 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:10 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b 1073741824" returned: 0 in 1.042s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:10 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b
Aug 29 13:12:10 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:10 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b" returned: 0 in 0.462s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:12:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a7717a-3941-4708-8e2a-13c8e3231522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09152c4-1407-4905-b828-e0574a02346b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5990c00b-1c82-492f-bf81-b11f16d253d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:10 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Volume volume-c09152c4-1407-4905-b828-e0574a02346b (c09152c4-1407-4905-b828-e0574a02346b): created successfully
Aug 29 13:12:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5990c00b-1c82-492f-bf81-b11f16d253d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (a6a0a6fd-fbfd-4222-be5c-2fbacee22132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6ba00e90-a12b-4792-9e5a-9290d4220b6b tempest-VolumesActionsTest-423248287 None] Created volume successfully.
Aug 29 13:12:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29d4bece-8729-4107-bfdb-dad967e0aaf6 tempest-VolumesActionsTest-423248287 None] Acquiring lock "cinder-c09152c4-1407-4905-b828-e0574a02346b" by "attach_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29d4bece-8729-4107-bfdb-dad967e0aaf6 tempest-VolumesActionsTest-423248287 None] Lock "cinder-c09152c4-1407-4905-b828-e0574a02346b" acquired by "attach_volume" :: waited 0.045s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:11 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-29d4bece-8729-4107-bfdb-dad967e0aaf6 tempest-VolumesActionsTest-423248287 None] Attaching volume c09152c4-1407-4905-b828-e0574a02346b to instance 26c80111-5f34-4fed-8bf3-f6408a489da7 at mountpoint /dev/vdb on host None.
Aug 29 13:12:11 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-29d4bece-8729-4107-bfdb-dad967e0aaf6 tempest-VolumesActionsTest-423248287 None] Attach volume completed successfully.
Aug 29 13:12:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29d4bece-8729-4107-bfdb-dad967e0aaf6 tempest-VolumesActionsTest-423248287 None] Lock "cinder-c09152c4-1407-4905-b828-e0574a02346b" released by "attach_volume" :: held 0.205s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f471dab4-ded7-437c-a07f-534df10554e6 tempest-VolumesActionsTest-1918024737 None] Terminate volume connection completed successfully.
Aug 29 13:12:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f471dab4-ded7-437c-a07f-534df10554e6 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "cinder-c09152c4-1407-4905-b828-e0574a02346b-detach_volume" by "detach_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f471dab4-ded7-437c-a07f-534df10554e6 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-c09152c4-1407-4905-b828-e0574a02346b-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f471dab4-ded7-437c-a07f-534df10554e6 tempest-VolumesActionsTest-1918024737 None] Detaching volume c09152c4-1407-4905-b828-e0574a02346b from instance 26c80111-5f34-4fed-8bf3-f6408a489da7.
Aug 29 13:12:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f471dab4-ded7-437c-a07f-534df10554e6 tempest-VolumesActionsTest-1918024737 None] Detach volume completed successfully.
Aug 29 13:12:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f471dab4-ded7-437c-a07f-534df10554e6 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-c09152c4-1407-4905-b828-e0574a02346b-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-89ccbabe-138c-4225-a390-c92c52b7cced tempest-VolumesActionsTest-423248287 None] Acquiring lock "cinder-c09152c4-1407-4905-b828-e0574a02346b-detach_volume" by "detach_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-89ccbabe-138c-4225-a390-c92c52b7cced tempest-VolumesActionsTest-423248287 None] Lock "cinder-c09152c4-1407-4905-b828-e0574a02346b-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-89ccbabe-138c-4225-a390-c92c52b7cced tempest-VolumesActionsTest-423248287 None] Volume detach called, but volume not attached.
Aug 29 13:12:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-89ccbabe-138c-4225-a390-c92c52b7cced tempest-VolumesActionsTest-423248287 None] Lock "cinder-c09152c4-1407-4905-b828-e0574a02346b-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Acquiring lock "cinder-c09152c4-1407-4905-b828-e0574a02346b-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Lock "cinder-c09152c4-1407-4905-b828-e0574a02346b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Acquiring lock "cinder-quobyte-c09152c4-1407-4905-b828-e0574a02346b" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Lock "cinder-quobyte-c09152c4-1407-4905-b828-e0574a02346b" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:14 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[24007f33-3a8f-40f7-93fb-bec6ef403002]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:12:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:14 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b
Aug 29 13:12:14 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:14 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b" returned: 0 in 0.905s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:15 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b
Aug 29 13:12:15 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:15 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c09152c4-1407-4905-b828-e0574a02346b" returned: 0 in 0.570s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Lock "cinder-quobyte-c09152c4-1407-4905-b828-e0574a02346b" released by "delete_volume" :: held 1.561s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Created reservations ['a024e5db-155b-43ce-b8c2-8beec2aaf552', 'cd72de17-a52a-4f32-9dc1-55199fbb547a', 'cbe542a1-d35a-4c60-951c-00c368eee7de', 'd976284b-74ed-4815-b5dd-54856f8a70c3'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:15 devstack sudo[89119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:12:15 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:16 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.358s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:16 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:12:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Deleted volume successfully.
Aug 29 13:12:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-40bed927-04bc-4434-95f4-e7a58aeb8bbb tempest-VolumesActionsTest-423248287 None] Lock "cinder-c09152c4-1407-4905-b828-e0574a02346b-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (eb8b8d9d-1b96-4be9-85b7-0dbe67d2bf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0934d4d7-e1d9-4ef9-aedd-8176bfbad9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0934d4d7-e1d9-4ef9-aedd-8176bfbad9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-376956008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e024bf7e-fc7d-4317-89b6-04250a6c8a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:23Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e7ed85-4470-48c8-a510-f6cc97a382b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e7ed85-4470-48c8-a510-f6cc97a382b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c739c6-bca3-400c-8a28-63631fe9500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c739c6-bca3-400c-8a28-63631fe9500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e024bf7e-fc7d-4317-89b6-04250a6c8a2c', 'volume_name': 'volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43848dad-88b0-46e4-90ec-0cf924eecf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43848dad-88b0-46e4-90ec-0cf924eecf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df48a29-37ad-4c88-aec7-157ba9b788c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:22 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Volume e024bf7e-fc7d-4317-89b6-04250a6c8a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c', 'volume_size': 1}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-376956008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e024bf7e-fc7d-4317-89b6-04250a6c8a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:23Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Creating volume e024bf7e-fc7d-4317-89b6-04250a6c8a2c {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:12:22 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:12:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:22 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c 1073741824
Aug 29 13:12:22 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:23 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c 1073741824" returned: 0 in 0.628s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:23 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c
Aug 29 13:12:23 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:24 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c" returned: 0 in 0.475s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:12:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df48a29-37ad-4c88-aec7-157ba9b788c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b066ba-a7e4-4c71-81ef-26acc9568f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:24 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Volume volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c (e024bf7e-fc7d-4317-89b6-04250a6c8a2c): created successfully
Aug 29 13:12:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b066ba-a7e4-4c71-81ef-26acc9568f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (eb8b8d9d-1b96-4be9-85b7-0dbe67d2bf1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b7478de9-211d-481d-8728-a221e56d28ca tempest-VolumesActionsTest-423248287 None] Created volume successfully.
Aug 29 13:12:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "cinder-e024bf7e-fc7d-4317-89b6-04250a6c8a2c-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-e024bf7e-fc7d-4317-89b6-04250a6c8a2c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "cinder-quobyte-e024bf7e-fc7d-4317-89b6-04250a6c8a2c" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-quobyte-e024bf7e-fc7d-4317-89b6-04250a6c8a2c" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:25 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[911650f7-9161-4d81-92f4-8759ec668965]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:12:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:25 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c
Aug 29 13:12:25 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:25 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c" returned: 0 in 0.564s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:25 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c
Aug 29 13:12:25 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:26 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e024bf7e-fc7d-4317-89b6-04250a6c8a2c" returned: 0 in 0.351s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-quobyte-e024bf7e-fc7d-4317-89b6-04250a6c8a2c" released by "delete_volume" :: held 0.975s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Created reservations ['f9ca3537-8908-4cc0-8a36-202b0adcc6ed', '90b3ba7f-703a-4dc9-98cf-a3e77a52279f', 'cae59f7c-e916-449f-ae69-7af747e0782e', 'b2f0a0b7-122e-4858-8533-03387d292cc7'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:26 devstack sudo[89305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:12:26 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:26 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.479s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:12:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Deleted volume successfully.
Aug 29 13:12:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0667b5f-570c-4c41-a3cd-fb3b1e44dea2 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-e024bf7e-fc7d-4317-89b6-04250a6c8a2c-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (3b878c7f-a78a-4774-a09c-6ad8e225e1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b59db8-c598-4f8e-98cf-414412ee6cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b59db8-c598-4f8e-98cf-414412ee6cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2026045886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2416f197-924f-414a-825c-a4f9fabb2324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:28Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97e2774-d3bb-4edf-b1c6-b2fcf485bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97e2774-d3bb-4edf-b1c6-b2fcf485bada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7a9151-6e02-432b-912f-a0f0b4c50334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7a9151-6e02-432b-912f-a0f0b4c50334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2416f197-924f-414a-825c-a4f9fabb2324', 'volume_name': 'volume-2416f197-924f-414a-825c-a4f9fabb2324', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304ea94b-230b-4bad-adef-b93f689041e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304ea94b-230b-4bad-adef-b93f689041e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63553076-fb00-44b0-8dbc-47fdbd8b8fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:28 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Volume 2416f197-924f-414a-825c-a4f9fabb2324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2416f197-924f-414a-825c-a4f9fabb2324', 'volume_size': 1}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2026045886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2416f197-924f-414a-825c-a4f9fabb2324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:28Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Creating volume 2416f197-924f-414a-825c-a4f9fabb2324 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:12:28 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:12:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:28 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324 1073741824
Aug 29 13:12:28 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:29 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324 1073741824" returned: 0 in 0.516s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:29 devstack sudo[89372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324
Aug 29 13:12:29 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:29 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324" returned: 0 in 0.303s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:12:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63553076-fb00-44b0-8dbc-47fdbd8b8fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2416f197-924f-414a-825c-a4f9fabb2324', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73d0702-4397-4789-8e76-8e386e7fb8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:29 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Volume volume-2416f197-924f-414a-825c-a4f9fabb2324 (2416f197-924f-414a-825c-a4f9fabb2324): created successfully
Aug 29 13:12:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73d0702-4397-4789-8e76-8e386e7fb8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (3b878c7f-a78a-4774-a09c-6ad8e225e1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:29 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4baac9a8-986f-405b-befc-bb8e9bd6a63a tempest-VolumesActionsTest-423248287 None] Created volume successfully.
Aug 29 13:12:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "cinder-2416f197-924f-414a-825c-a4f9fabb2324-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-2416f197-924f-414a-825c-a4f9fabb2324-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "cinder-quobyte-2416f197-924f-414a-825c-a4f9fabb2324" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-quobyte-2416f197-924f-414a-825c-a4f9fabb2324" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b58d3a-296c-4b98-b11f-341c9e077642]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:12:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:30 devstack sudo[89377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324
Aug 29 13:12:30 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:31 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324" returned: 0 in 0.394s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:31 devstack sudo[89382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324
Aug 29 13:12:31 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:31 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2416f197-924f-414a-825c-a4f9fabb2324" returned: 0 in 0.326s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-quobyte-2416f197-924f-414a-825c-a4f9fabb2324" released by "delete_volume" :: held 0.764s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Created reservations ['a1d49788-af31-43ce-a0a0-d93f617a0e07', 'fff32817-9942-4076-8c8d-d665b9266bc5', 'd5e73f91-7d4a-471b-bb2b-a3df45be1e23', '5ffaecd0-7706-49ba-a972-ee2184b90dd8'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:31 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:12:31 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.300s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:31 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:12:31 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Deleted volume successfully.
Aug 29 13:12:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54bc003-114d-4d67-bdad-e86285d3a363 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-2416f197-924f-414a-825c-a4f9fabb2324-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (bb77cffc-44fe-4182-91f3-9366ed428816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9337987f-00d1-41e2-b187-ecc4879ab566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9337987f-00d1-41e2-b187-ecc4879ab566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc523eb6-e634-4b92-958c-807b0ff429d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:33Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051cc1bb-00e3-48c8-8a02-fa7e3a4f15a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051cc1bb-00e3-48c8-8a02-fa7e3a4f15a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95555edc-9c5e-4b69-aa21-f9102ff85e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95555edc-9c5e-4b69-aa21-f9102ff85e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc523eb6-e634-4b92-958c-807b0ff429d1', 'volume_name': 'volume-cc523eb6-e634-4b92-958c-807b0ff429d1', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7aa285-8947-428d-bccc-558b461b6c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7aa285-8947-428d-bccc-558b461b6c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980b691a-75f7-49a7-a03b-69034c21eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:32 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Volume cc523eb6-e634-4b92-958c-807b0ff429d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc523eb6-e634-4b92-958c-807b0ff429d1', 'volume_size': 1}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc523eb6-e634-4b92-958c-807b0ff429d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:33Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Creating volume cc523eb6-e634-4b92-958c-807b0ff429d1 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:12:32 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:32 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1 1073741824
Aug 29 13:12:32 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-9b2f2f75-3bb4-4c4b-84f0-c2383bc6130b req-76e6f7d4-bff7-47fc-bf50-a4e39fb0180c tempest-AttachVolumeNegativeTest-583345777 None] Terminate volume connection completed successfully.
Aug 29 13:12:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-9b2f2f75-3bb4-4c4b-84f0-c2383bc6130b req-76e6f7d4-bff7-47fc-bf50-a4e39fb0180c tempest-AttachVolumeNegativeTest-583345777 None] Deleting attachment 70398f73-757c-4e11-995d-147a593e09dd. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:12:33 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1 1073741824" returned: 0 in 0.462s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:33 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1
Aug 29 13:12:33 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:33 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1" returned: 0 in 0.269s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:12:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980b691a-75f7-49a7-a03b-69034c21eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc523eb6-e634-4b92-958c-807b0ff429d1', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1815f0-0960-41a6-87ab-3e1eeda3cc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:33 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Volume volume-cc523eb6-e634-4b92-958c-807b0ff429d1 (cc523eb6-e634-4b92-958c-807b0ff429d1): created successfully
Aug 29 13:12:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1815f0-0960-41a6-87ab-3e1eeda3cc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (bb77cffc-44fe-4182-91f3-9366ed428816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:33 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1f850229-67b4-4695-96c1-658e65a23b01 tempest-VolumesActionsTest-423248287 None] Created volume successfully.
Aug 29 13:12:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "cinder-cc523eb6-e634-4b92-958c-807b0ff429d1-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-cc523eb6-e634-4b92-958c-807b0ff429d1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "cinder-quobyte-cc523eb6-e634-4b92-958c-807b0ff429d1" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-quobyte-cc523eb6-e634-4b92-958c-807b0ff429d1" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c68228-84b4-49a4-a082-c6bb5087c8d4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:35 devstack sudo[89451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1
Aug 29 13:12:35 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:35 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1" returned: 0 in 0.475s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:35 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1
Aug 29 13:12:35 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:35 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cc523eb6-e634-4b92-958c-807b0ff429d1" returned: 0 in 0.294s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-quobyte-cc523eb6-e634-4b92-958c-807b0ff429d1" released by "delete_volume" :: held 0.827s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Created reservations ['016ce7d0-dba4-4de4-90a4-70b38275f4c6', '2d71257f-29c8-4c71-a399-c9c4af60f285', '9b4cf8cc-e2e4-4a5a-9634-f9d52ba9a7e6', 'd1608aeb-eb4e-439a-b18e-41c9602a1381'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:36 devstack sudo[89463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:12:36 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:36 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.325s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:12:36 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Deleted volume successfully.
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-560f9432-d8e5-48aa-9b7d-c0d56a9c0299 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-cc523eb6-e634-4b92-958c-807b0ff429d1-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (c8ca9b46-5046-4751-aaa0-58a7db448591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca8996b-c720-45cb-9d4b-365b1e8779fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca8996b-c720-45cb-9d4b-365b1e8779fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-851987923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:37Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e696ab-23f3-4988-8631-7f4418abb04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e696ab-23f3-4988-8631-7f4418abb04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78dc7f9-20a7-42cc-9825-5a8538f19d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78dc7f9-20a7-42cc-9825-5a8538f19d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f', 'volume_name': 'volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00483dc0-c210-41b0-8c7b-a2ecd52fac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00483dc0-c210-41b0-8c7b-a2ecd52fac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aaa652-c117-4a50-b602-77e902b7381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:36 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Volume 564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f', 'volume_size': 1}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-851987923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:37Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Creating volume 564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:12:36 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:12:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:36 devstack sudo[89467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f 1073741824
Aug 29 13:12:36 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:37 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f 1073741824" returned: 0 in 0.409s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:37 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f
Aug 29 13:12:37 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:37 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f" returned: 0 in 0.241s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aaa652-c117-4a50-b602-77e902b7381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5f4bd3-5629-41a9-ab8a-c2e965dd44a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:37 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Volume volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f (564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f): created successfully
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5f4bd3-5629-41a9-ab8a-c2e965dd44a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (c8ca9b46-5046-4751-aaa0-58a7db448591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:37 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-735a788c-6f21-48a5-a1ef-ef1905387ba8 tempest-VolumesActionsTest-423248287 None] Created volume successfully.
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "cinder-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "cinder-quobyte-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-quobyte-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6120830-3eca-4fce-9332-5099c11b1ecd]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:38 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f
Aug 29 13:12:38 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:38 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f" returned: 0 in 0.346s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:38 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f
Aug 29 13:12:38 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:38 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-quobyte-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f" released by "delete_volume" :: held 0.634s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Created reservations ['18ddcedc-2abd-41ba-93bf-3f911e1c0b2d', '6d6a5754-e153-496d-9f0f-b57143a2a068', 'bb59b8b2-b3a1-4717-915d-ba9e80b42e42', 'b69caac3-e66d-4bd8-aa44-b8339e3f8aee'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:38 devstack sudo[89483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:12:38 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:39 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:12:39 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Deleted volume successfully.
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-52ca8f90-96cb-4018-94cf-67b2af4bbb64 tempest-VolumesActionsTest-1918024737 None] Lock "cinder-564ff8e0-d3b9-4e71-91c1-eaf61c9eb07f-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (6de27c3e-6459-4319-b8cc-5fd621b03f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e5a162-81d8-4d36-ade3-d17aa460598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e5a162-81d8-4d36-ade3-d17aa460598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1551885856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18c2f10-ea1c-437d-8278-04ae7d1dd354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:40Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62732de3-9133-4a42-95bd-31b2ece7b61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62732de3-9133-4a42-95bd-31b2ece7b61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ccf263-cbe4-49dc-bf43-523d9e42c923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ccf263-cbe4-49dc-bf43-523d9e42c923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18c2f10-ea1c-437d-8278-04ae7d1dd354', 'volume_name': 'volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ae3aae-8903-4453-9c93-f9f95df94e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ae3aae-8903-4453-9c93-f9f95df94e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cc002d-e3b8-4781-a402-5c5c39910236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:39 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Volume b18c2f10-ea1c-437d-8278-04ae7d1dd354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354', 'volume_size': 1}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1551885856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18c2f10-ea1c-437d-8278-04ae7d1dd354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4d8b9e3dcb4049bfbe4f52f35bedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:12:40Z,use_quota=True,user_id='c08a106819974fcea27c13cc7ffb5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Creating volume b18c2f10-ea1c-437d-8278-04ae7d1dd354 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:12:39 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:12:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:39 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354 1073741824
Aug 29 13:12:39 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:40 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354 1073741824" returned: 0 in 0.441s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:40 devstack sudo[89499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354
Aug 29 13:12:40 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:40 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354" returned: 0 in 0.242s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:12:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cc002d-e3b8-4781-a402-5c5c39910236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c28708-124c-4096-b26d-deb4215adefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:12:40 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Volume volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354 (b18c2f10-ea1c-437d-8278-04ae7d1dd354): created successfully
Aug 29 13:12:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c28708-124c-4096-b26d-deb4215adefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:12:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Flow 'volume_create_manager' (6de27c3e-6459-4319-b8cc-5fd621b03f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:12:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3283df98-a9db-4575-be4b-3262ccc47579 tempest-VolumesActionsTest-423248287 None] Created volume successfully.
Aug 29 13:12:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Acquiring lock "cinder-b18c2f10-ea1c-437d-8278-04ae7d1dd354-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Lock "cinder-b18c2f10-ea1c-437d-8278-04ae7d1dd354-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Acquiring lock "cinder-quobyte-b18c2f10-ea1c-437d-8278-04ae7d1dd354" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:12:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Lock "cinder-quobyte-b18c2f10-ea1c-437d-8278-04ae7d1dd354" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:12:41 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c6a70-be45-4b6d-a456-79d0cccb8649]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:12:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:41 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354
Aug 29 13:12:41 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:41 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354" returned: 0 in 0.381s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:41 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354
Aug 29 13:12:41 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:42 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b18c2f10-ea1c-437d-8278-04ae7d1dd354" returned: 0 in 0.296s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Lock "cinder-quobyte-b18c2f10-ea1c-437d-8278-04ae7d1dd354" released by "delete_volume" :: held 0.745s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Created reservations ['1f76d3a6-c1a5-4127-91cb-953f7b91a37f', 'b9ebde86-2aec-47fe-aeb9-cf988911a9e6', '9fb98b0d-3441-4158-a82a-e5a3ca26ad98', '106a1196-5a7e-442e-904c-853701289c7a'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:42 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:12:42 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:42 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.307s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:12:42 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Deleted volume successfully.
Aug 29 13:12:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcb0b94d-8191-4211-85e1-06d99cafa574 tempest-VolumesActionsTest-423248287 None] Lock "cinder-b18c2f10-ea1c-437d-8278-04ae7d1dd354-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:12:49 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=66,cinder:UPDATE=72,cinder:DELETE=4,cinder:INSERT=14 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:12:49 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=70,cinder:UPDATE=80,cinder:INSERT=19,cinder:DELETE=9 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:12:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-70e11c24-0932-4e22-87e0-6b06cdc24b51 req-f7591d85-f686-48ed-9837-a052e7c61a42 tempest-ServerActionsTestOtherA-452165374 None] Terminate volume connection completed successfully.
Aug 29 13:12:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-70e11c24-0932-4e22-87e0-6b06cdc24b51 req-f7591d85-f686-48ed-9837-a052e7c61a42 tempest-ServerActionsTestOtherA-452165374 None] Deleting attachment c93faf0c-067c-4dac-8d40-e1de9605ca94. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-8a2e0300-847c-4225-b031-fe8bb6feb687 req-9ddf95cd-a97f-4c92-9bf5-54bf5e09a026 tempest-TaggedAttachmentsTest-283506461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-8a2e0300-847c-4225-b031-fe8bb6feb687 req-9ddf95cd-a97f-4c92-9bf5-54bf5e09a026 tempest-TaggedAttachmentsTest-283506461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-8a2e0300-847c-4225-b031-fe8bb6feb687 req-9ddf95cd-a97f-4c92-9bf5-54bf5e09a026 tempest-TaggedAttachmentsTest-283506461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.057s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:12:54 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:12:54 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:12:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-8a2e0300-847c-4225-b031-fe8bb6feb687 req-9ddf95cd-a97f-4c92-9bf5-54bf5e09a026 tempest-TaggedAttachmentsTest-283506461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-606b87b1-f4a9-47ab-93bb-d897497f9452', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7fb3d33-ef33-4f3b-91d7-e0c527119c72', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:12:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-8a2e0300-847c-4225-b031-fe8bb6feb687 req-9ddf95cd-a97f-4c92-9bf5-54bf5e09a026 tempest-TaggedAttachmentsTest-283506461 None] attachment_update completed successfully.
Aug 29 13:12:55 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Aug 29 13:12:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.622s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:12:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:12:55 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:12:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 8 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:12:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:12:58 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-339214ac-5c70-4241-bb34-66dbae2dbc32 req-44e65a43-e6f2-4aee-bd13-e9601274bb63 tempest-TaggedAttachmentsTest-283506461 None] Terminate volume connection completed successfully.
Aug 29 13:12:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-339214ac-5c70-4241-bb34-66dbae2dbc32 req-44e65a43-e6f2-4aee-bd13-e9601274bb63 tempest-TaggedAttachmentsTest-283506461 None] Deleting attachment a7fb3d33-ef33-4f3b-91d7-e0c527119c72. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:13:00 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:13:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Flow 'volume_create_manager' (692d739c-5484-4fdd-ada1-9f29ea04217a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:13:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340ade97-689d-494a-a277-b384990a1254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340ade97-689d-494a-a277-b384990a1254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1026448070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca9d928-b911-44e0-a80e-f5ccc0d7b233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09da69ecb5b34e28adbc6ab51cf0a2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:13:00Z,use_quota=True,user_id='d8c0389300c14cf4882094dadbdb16e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf014d76-6c29-4047-afc9-2ba46f94e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf014d76-6c29-4047-afc9-2ba46f94e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11277e2-aa4b-4c25-a72e-493aae8aa1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:00 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:13:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11277e2-aa4b-4c25-a72e-493aae8aa1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ca9d928-b911-44e0-a80e-f5ccc0d7b233', 'volume_name': 'volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6209a4d10>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e7d844-6643-4f4e-9bdc-a396e187aa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e7d844-6643-4f4e-9bdc-a396e187aa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005c1b01-ec67-4ac6-b37a-473ccb7f1ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:01 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Volume 6ca9d928-b911-44e0-a80e-f5ccc0d7b233: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6209a4d10>}
Aug 29 13:13:01 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Trying to clone 6ca9d928-b911-44e0-a80e-f5ccc0d7b233 from image 9ccc8465-2a9b-49d5-8097-23b2336c201f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:13:02 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:13:02 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Image download 20.69 MB at 20.69 MB/s
Aug 29 13:13:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb1b9a0-1fdc-4847-8303-39f8205641e8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:02 devstack sudo[90170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD
Aug 29 13:13:02 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:02 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:02 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f is fetched for user d8c0389300c14cf4882094dadbdb16e3. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:13:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8da811c-131c-4f19-9e80-fd801c0f31c2]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:03 devstack sudo[90175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD
Aug 29 13:13:03 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:03 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1026448070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca9d928-b911-44e0-a80e-f5ccc0d7b233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09da69ecb5b34e28adbc6ab51cf0a2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:13:00Z,use_quota=True,user_id='d8c0389300c14cf4882094dadbdb16e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Creating volume 6ca9d928-b911-44e0-a80e-f5ccc0d7b233 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:13:03 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:03 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 1073741824
Aug 29 13:13:03 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:03 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 1073741824" returned: 0 in 0.531s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:03 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233
Aug 29 13:13:03 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:04 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233" returned: 0 in 0.308s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:13:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:04 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Attempting download of 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume 6ca9d928-b911-44e0-a80e-f5ccc0d7b233. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:13:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1993fd2-fff5-4e78-9792-84b74c319904]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_ayhjs5do {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:04 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_ayhjs5do
Aug 29 13:13:04 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:04 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_ayhjs5do" returned: 0 in 0.489s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_ayhjs5do {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:04 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_ayhjs5do
Aug 29 13:13:04 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:05 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_ayhjs5do" returned: 1 in 0.387s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_ayhjs5do' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:13:05 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf5e10b-780b-4242-8499-a3a10f07d0ae]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:05 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD
Aug 29 13:13:05 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:05 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:05 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] 9ccc8465-2a9b-49d5-8097-23b2336c201f was qcow2, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:13:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:05 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233
Aug 29 13:13:05 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:07 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233" returned: 0 in 2.183s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:07 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_25fxcgdmdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:13:07 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Converted 112.00 MB image at 51.27 MB/s
Aug 29 13:13:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:07 devstack sudo[90265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 1G
Aug 29 13:13:07 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:08 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 1G" returned: 0 in 0.368s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Downloaded image 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume 6ca9d928-b911-44e0-a80e-f5ccc0d7b233 successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f for user d8c0389300c14cf4882094dadbdb16e3 is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Marking volume 6ca9d928-b911-44e0-a80e-f5ccc0d7b233 as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Copying metadata from image 9ccc8465-2a9b-49d5-8097-23b2336c201f to 6ca9d928-b911-44e0-a80e-f5ccc0d7b233. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Creating volume glance metadata for volume 6ca9d928-b911-44e0-a80e-f5ccc0d7b233 backed by image 9ccc8465-2a9b-49d5-8097-23b2336c201f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005c1b01-ec67-4ac6-b37a-473ccb7f1ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6209a4d10>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc0a297-1ac7-418b-964a-fb351ff11f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:08 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Volume volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 (6ca9d928-b911-44e0-a80e-f5ccc0d7b233): created successfully
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc0a297-1ac7-418b-964a-fb351ff11f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Flow 'volume_create_manager' (692d739c-5484-4fdd-ada1-9f29ea04217a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Flow 'volume_create_manager' (72335aa7-45fe-42c1-a072-a2d82a5f7f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80133327-6d2a-4ead-887f-bf3f380146fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:08 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-aff144fa-8ff6-496a-ad58-142bfd6636f2 tempest-ServerActionsTestOtherA-452165374 None] Created volume successfully.
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80133327-6d2a-4ead-887f-bf3f380146fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1662322357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8352d7e-5f6a-43f6-ad54-811afce9379b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a7e17d2a574a99919d73de3609a333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:13:08Z,use_quota=True,user_id='89c5356b5baa41a29c56490be5849e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cd1663-68e2-42fc-b644-9c87dfc66add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cd1663-68e2-42fc-b644-9c87dfc66add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95bcfa0-1e89-4752-a029-9c5ae110bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95bcfa0-1e89-4752-a029-9c5ae110bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8352d7e-5f6a-43f6-ad54-811afce9379b', 'volume_name': 'volume-c8352d7e-5f6a-43f6-ad54-811afce9379b', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b620822300>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313fb148-a60c-4973-bcad-eebf570c32fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313fb148-a60c-4973-bcad-eebf570c32fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a35fc0-706b-441a-90fb-479c3338e47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:08 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Volume c8352d7e-5f6a-43f6-ad54-811afce9379b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8352d7e-5f6a-43f6-ad54-811afce9379b', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b620822300>}
Aug 29 13:13:08 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Trying to clone c8352d7e-5f6a-43f6-ad54-811afce9379b from image 9ccc8465-2a9b-49d5-8097-23b2336c201f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:13:09 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Image download 20.69 MB at 20.69 MB/s
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e381d5-77f6-4b15-a95b-fa7e3fd735ce]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:09 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD
Aug 29 13:13:09 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:09 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f is fetched for user 89c5356b5baa41a29c56490be5849e6f. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96bbf6d-8a14-473b-98b5-d309c5a3e1ec]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:09 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD
Aug 29 13:13:09 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:09 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1662322357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8352d7e-5f6a-43f6-ad54-811afce9379b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a7e17d2a574a99919d73de3609a333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:13:08Z,use_quota=True,user_id='89c5356b5baa41a29c56490be5849e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Creating volume c8352d7e-5f6a-43f6-ad54-811afce9379b {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:13:09 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:13:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:09 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b 1073741824
Aug 29 13:13:09 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:10 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b 1073741824" returned: 0 in 0.671s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Acquiring lock "cinder-606b87b1-f4a9-47ab-93bb-d897497f9452-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:13:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Lock "cinder-606b87b1-f4a9-47ab-93bb-d897497f9452-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:13:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:10 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b
Aug 29 13:13:10 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Acquiring lock "cinder-quobyte-606b87b1-f4a9-47ab-93bb-d897497f9452" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:13:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Lock "cinder-quobyte-606b87b1-f4a9-47ab-93bb-d897497f9452" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:13:10 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a1157c-8d82-4457-9d76-feb5943cc9b6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:10 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452
Aug 29 13:13:10 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:11 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Attempting download of 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume c8352d7e-5f6a-43f6-ad54-811afce9379b. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7af74f-58e3-4870-95eb-aeb2d650a385]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_8orbboim {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:11 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452" returned: 0 in 0.519s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:11 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_8orbboim
Aug 29 13:13:11 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:11 devstack sudo[90307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452
Aug 29 13:13:11 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:11 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-606b87b1-f4a9-47ab-93bb-d897497f9452" returned: 0 in 0.369s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:11 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Lock "cinder-quobyte-606b87b1-f4a9-47ab-93bb-d897497f9452" released by "delete_volume" :: held 0.985s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_8orbboim" returned: 0 in 0.558s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_8orbboim {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Created reservations ['df2041d2-5129-41ad-90c2-9a73fe8c45ca', '3896ed53-8200-4e00-937e-2971977dbcbf', '0c908088-af0b-411e-8cbb-c23c8282bc41', 'eee132c2-27de-4b02-976d-978beded40e5'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:13:11 devstack sudo[90313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_8orbboim
Aug 29 13:13:11 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:11 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:13:11 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:12 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_8orbboim" returned: 1 in 0.462s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_8orbboim' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae5ae6f-e5f8-470d-8f5f-d963d1a020b1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:12 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.381s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:13:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Deleted volume successfully.
Aug 29 13:13:12 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD
Aug 29 13:13:12 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-665c2976-aea2-461c-aef2-2b0012132014 tempest-TaggedAttachmentsTest-283506461 None] Lock "cinder-606b87b1-f4a9-47ab-93bb-d897497f9452-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-5f56a9b7-55a5-42dc-8929-5879db58ceb1 req-e49f1dff-5f5e-4e84-9386-ed4bef21fd88 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-5f56a9b7-55a5-42dc-8929-5879db58ceb1 req-e49f1dff-5f5e-4e84-9386-ed4bef21fd88 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-5f56a9b7-55a5-42dc-8929-5879db58ceb1 req-e49f1dff-5f5e-4e84-9386-ed4bef21fd88 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:12 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] 9ccc8465-2a9b-49d5-8097-23b2336c201f was qcow2, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-5f56a9b7-55a5-42dc-8929-5879db58ceb1 req-e49f1dff-5f5e-4e84-9386-ed4bef21fd88 tempest-ServerActionsTestOtherA-452165374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1c8ffe4-7ddd-477d-967f-bf2cec649287', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:13:12 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b
Aug 29 13:13:12 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-5f56a9b7-55a5-42dc-8929-5879db58ceb1 req-e49f1dff-5f5e-4e84-9386-ed4bef21fd88 tempest-ServerActionsTestOtherA-452165374 None] attachment_update completed successfully.
Aug 29 13:13:14 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b" returned: 0 in 2.127s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:14 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f__k533ucrdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:13:14 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Converted 112.00 MB image at 52.63 MB/s
Aug 29 13:13:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:14 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b 1G
Aug 29 13:13:14 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:15 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b 1G" returned: 0 in 0.377s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Downloaded image 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume c8352d7e-5f6a-43f6-ad54-811afce9379b successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f for user 89c5356b5baa41a29c56490be5849e6f is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Marking volume c8352d7e-5f6a-43f6-ad54-811afce9379b as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Copying metadata from image 9ccc8465-2a9b-49d5-8097-23b2336c201f to c8352d7e-5f6a-43f6-ad54-811afce9379b. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Creating volume glance metadata for volume c8352d7e-5f6a-43f6-ad54-811afce9379b backed by image 9ccc8465-2a9b-49d5-8097-23b2336c201f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a35fc0-706b-441a-90fb-479c3338e47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8352d7e-5f6a-43f6-ad54-811afce9379b', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b620822300>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e32d69b-a24c-425e-bc67-03905456164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:15 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Volume volume-c8352d7e-5f6a-43f6-ad54-811afce9379b (c8352d7e-5f6a-43f6-ad54-811afce9379b): created successfully
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e32d69b-a24c-425e-bc67-03905456164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Flow 'volume_create_manager' (72335aa7-45fe-42c1-a072-a2d82a5f7f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:13:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f0b7c2fc-b3d5-4c64-b178-399185a3d77b tempest-VolumesImageMetadata-493032422 None] Created volume successfully.
Aug 29 13:13:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Acquiring lock "cinder-c8352d7e-5f6a-43f6-ad54-811afce9379b-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:13:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Lock "cinder-c8352d7e-5f6a-43f6-ad54-811afce9379b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:13:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Acquiring lock "cinder-quobyte-c8352d7e-5f6a-43f6-ad54-811afce9379b" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:13:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Lock "cinder-quobyte-c8352d7e-5f6a-43f6-ad54-811afce9379b" acquired by "delete_volume" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:13:16 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cb62d1-3402-4652-a0c1-ddf4776a7973]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:13:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Flow 'volume_create_manager' (9d0f51e8-ef72-4c84-90d3-0a1037205a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f0cb48-1a69-4bbf-9f42-da8c4d0fe5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:17 devstack sudo[90807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b
Aug 29 13:13:17 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f0cb48-1a69-4bbf-9f42-da8c4d0fe5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1888778858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ea232-c2fa-498b-accf-cb195b6a2860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7325a4347b39498fa3253f6d2c101fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:13:17Z,use_quota=True,user_id='da109bda0fe94b61b4c1b1f494016741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b24108-979b-4c58-a898-af6d93550f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b24108-979b-4c58-a898-af6d93550f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703e258b-1e3d-49cf-8149-dcbb578dd7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703e258b-1e3d-49cf-8149-dcbb578dd7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01ea232-c2fa-498b-accf-cb195b6a2860', 'volume_name': 'volume-a01ea232-c2fa-498b-accf-cb195b6a2860', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bfc068-ef26-4bfd-811b-70f6f0546e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bfc068-ef26-4bfd-811b-70f6f0546e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafca047-740c-4753-b6d2-55b1f5089bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:17 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Volume a01ea232-c2fa-498b-accf-cb195b6a2860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01ea232-c2fa-498b-accf-cb195b6a2860', 'volume_size': 1}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1888778858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ea232-c2fa-498b-accf-cb195b6a2860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7325a4347b39498fa3253f6d2c101fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:13:17Z,use_quota=True,user_id='da109bda0fe94b61b4c1b1f494016741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Creating volume a01ea232-c2fa-498b-accf-cb195b6a2860 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:13:17 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:17 devstack sudo[90809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860 1073741824
Aug 29 13:13:17 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:17 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b" returned: 0 in 0.580s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:17 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b
Aug 29 13:13:17 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:17 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860 1073741824" returned: 0 in 0.623s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:18 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:18 devstack sudo[90823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860
Aug 29 13:13:18 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8352d7e-5f6a-43f6-ad54-811afce9379b" returned: 0 in 0.500s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Lock "cinder-quobyte-c8352d7e-5f6a-43f6-ad54-811afce9379b" released by "delete_volume" :: held 1.189s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Created reservations ['4623f81f-92c5-4509-8d97-cef50cb1d2ff', 'b38020ac-fc9d-427a-b185-0e3c48d14add', '6fe9538d-5c22-4a44-88ca-6e798d8d418b', '6545affc-30a1-4eb5-a79c-fc8d3442a5f4'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:18 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:13:18 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:18 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860" returned: 0 in 0.509s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafca047-740c-4753-b6d2-55b1f5089bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01ea232-c2fa-498b-accf-cb195b6a2860', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f914850-a519-4ec6-9bff-b4c464893672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Volume volume-a01ea232-c2fa-498b-accf-cb195b6a2860 (a01ea232-c2fa-498b-accf-cb195b6a2860): created successfully
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f914850-a519-4ec6-9bff-b4c464893672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Flow 'volume_create_manager' (9d0f51e8-ef72-4c84-90d3-0a1037205a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:13:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fcfbad6f-c681-430a-afb2-66ab2f99b9b9 tempest-AttachVolumeNegativeTest-583345777 None] Created volume successfully.
Aug 29 13:13:18 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.337s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:13:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Deleted volume successfully.
Aug 29 13:13:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3986d6c2-adc3-4585-8e9c-3610722443fb tempest-VolumesImageMetadata-493032422 None] Lock "cinder-c8352d7e-5f6a-43f6-ad54-811afce9379b-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:13:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-599f95df-d711-46e3-a6bd-9336f71cf656 req-3c6d3ad4-f4ec-4e9c-81b2-52f14efabeb5 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-599f95df-d711-46e3-a6bd-9336f71cf656 req-3c6d3ad4-f4ec-4e9c-81b2-52f14efabeb5 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-599f95df-d711-46e3-a6bd-9336f71cf656 req-3c6d3ad4-f4ec-4e9c-81b2-52f14efabeb5 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-599f95df-d711-46e3-a6bd-9336f71cf656 req-3c6d3ad4-f4ec-4e9c-81b2-52f14efabeb5 tempest-AttachVolumeNegativeTest-583345777 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-a01ea232-c2fa-498b-accf-cb195b6a2860', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a787dd17-b719-48e3-b2e0-b7bbea391aa9', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:13:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-599f95df-d711-46e3-a6bd-9336f71cf656 req-3c6d3ad4-f4ec-4e9c-81b2-52f14efabeb5 tempest-AttachVolumeNegativeTest-583345777 None] attachment_update completed successfully.
Aug 29 13:13:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-8ecad238-10ee-454f-9e71-b56455deab53 req-0e5bea11-20e1-46e4-9799-e1b476d407ba tempest-AttachVolumeNegativeTest-583345777 None] Terminate volume connection completed successfully.
Aug 29 13:13:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-8ecad238-10ee-454f-9e71-b56455deab53 req-0e5bea11-20e1-46e4-9799-e1b476d407ba tempest-AttachVolumeNegativeTest-583345777 None] Deleting attachment a787dd17-b719-48e3-b2e0-b7bbea391aa9. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:13:26 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:13:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Flow 'volume_create_manager' (b3c51f8b-a1ec-4e04-9bc5-dedbf01aa8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:13:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea64dc0-bf1b-4533-b581-501a630e04a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea64dc0-bf1b-4533-b581-501a630e04a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1459559751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69b48b4-15b7-436d-9fa3-647bd0000fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72f2d97c61d4fa1911548311d337e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:13:27Z,use_quota=True,user_id='adafb0fb3189493ea639bea64a6ba049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4f5821-66af-4e2c-a316-6cb981b11bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4f5821-66af-4e2c-a316-6cb981b11bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e628a6c6-4f6b-412f-a8da-913ad1c37f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e628a6c6-4f6b-412f-a8da-913ad1c37f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69b48b4-15b7-436d-9fa3-647bd0000fe3', 'volume_name': 'volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85e46b-dcb9-4fc1-a877-e9ce0ef6e8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85e46b-dcb9-4fc1-a877-e9ce0ef6e8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e741a311-64a6-486c-b860-1d9d82815967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:27 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Volume f69b48b4-15b7-436d-9fa3-647bd0000fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3', 'volume_size': 1}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1459559751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69b48b4-15b7-436d-9fa3-647bd0000fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72f2d97c61d4fa1911548311d337e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:13:27Z,use_quota=True,user_id='adafb0fb3189493ea639bea64a6ba049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Creating volume f69b48b4-15b7-436d-9fa3-647bd0000fe3 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:13:27 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:13:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:27 devstack sudo[90889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3 1073741824
Aug 29 13:13:27 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:28 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3 1073741824" returned: 0 in 0.938s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:28 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3
Aug 29 13:13:28 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:28 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3" returned: 0 in 0.456s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:13:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e741a311-64a6-486c-b860-1d9d82815967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ad6bea-a1d7-47f7-bb7b-632b5033ebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:13:28 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Volume volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3 (f69b48b4-15b7-436d-9fa3-647bd0000fe3): created successfully
Aug 29 13:13:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ad6bea-a1d7-47f7-bb7b-632b5033ebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:13:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Flow 'volume_create_manager' (b3c51f8b-a1ec-4e04-9bc5-dedbf01aa8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:13:28 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-209133b5-4601-41c1-8e26-d2a6ba97117e tempest-VolumesNegativeTest-1828582667 None] Created volume successfully.
Aug 29 13:13:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-261bf722-9e26-47af-9ad8-9147270db260 req-2a78ddeb-4efb-4394-8ebc-9ac692ff8b15 tempest-ServerActionsTestOtherA-452165374 None] Terminate volume connection completed successfully.
Aug 29 13:13:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-261bf722-9e26-47af-9ad8-9147270db260 req-2a78ddeb-4efb-4394-8ebc-9ac692ff8b15 tempest-ServerActionsTestOtherA-452165374 None] Deleting attachment c1c8ffe4-7ddd-477d-967f-bf2cec649287. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:13:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-261bf722-9e26-47af-9ad8-9147270db260 req-e1f561bf-8fae-4a98-8e92-233f497901ca tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-261bf722-9e26-47af-9ad8-9147270db260 req-e1f561bf-8fae-4a98-8e92-233f497901ca tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-261bf722-9e26-47af-9ad8-9147270db260 req-e1f561bf-8fae-4a98-8e92-233f497901ca tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-261bf722-9e26-47af-9ad8-9147270db260 req-e1f561bf-8fae-4a98-8e92-233f497901ca tempest-ServerActionsTestOtherA-452165374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '459c2622-9efa-407c-86fb-1eee175977ae', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:13:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-261bf722-9e26-47af-9ad8-9147270db260 req-e1f561bf-8fae-4a98-8e92-233f497901ca tempest-ServerActionsTestOtherA-452165374 None] attachment_update completed successfully.
Aug 29 13:13:48 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=65,cinder:UPDATE=24,cinder:INSERT=17,cinder:DELETE=3 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:13:48 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=59,cinder:UPDATE=50,cinder:INSERT=21,cinder:DELETE=3 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:13:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:13:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:13:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:13:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:13:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:13:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:13:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:13:54 devstack sudo[91600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:13:54 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:13:55 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root
Aug 29 13:13:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.776s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:13:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:13:55 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:13:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:13:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:14:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Acquiring lock "cinder-f69b48b4-15b7-436d-9fa3-647bd0000fe3-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Lock "cinder-f69b48b4-15b7-436d-9fa3-647bd0000fe3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Acquiring lock "cinder-quobyte-f69b48b4-15b7-436d-9fa3-647bd0000fe3" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Lock "cinder-quobyte-f69b48b4-15b7-436d-9fa3-647bd0000fe3" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09dfbdc-1a13-4362-8f88-8b78e2f4ef27]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:02 devstack sudo[91639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3
Aug 29 13:14:02 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:02 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3" returned: 0 in 0.461s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:02 devstack sudo[91645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3
Aug 29 13:14:02 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:03 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f69b48b4-15b7-436d-9fa3-647bd0000fe3" returned: 0 in 0.522s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Lock "cinder-quobyte-f69b48b4-15b7-436d-9fa3-647bd0000fe3" released by "delete_volume" :: held 1.102s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Created reservations ['ea0bdbc7-281f-44fb-9994-5c85a0dc8585', 'a9c80002-8667-428c-8ae7-b4ee1564fbed', '90f4ae32-4fd0-475d-9302-05a45176bad6', '748e08f4-635f-4b44-940b-1e09bba9b780'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:03 devstack sudo[91658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:03 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:03 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.273s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:03 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Deleted volume successfully.
Aug 29 13:14:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3787d623-ba5b-4c0d-8416-819a0d88349b tempest-VolumesNegativeTest-1828582667 None] Lock "cinder-f69b48b4-15b7-436d-9fa3-647bd0000fe3-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:13 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:14:13 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Flow 'volume_create_manager' (7e0a9b6e-de48-4343-9079-dbed6ffd9339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e619a7ea-a484-405e-85a4-dbb7eb9d33d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e619a7ea-a484-405e-85a4-dbb7eb9d33d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-508855196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78dc7b33-6deb-4302-a16a-e77b07782c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7325a4347b39498fa3253f6d2c101fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:21Z,use_quota=True,user_id='da109bda0fe94b61b4c1b1f494016741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b913cb82-fb5e-487b-a995-64273fc974fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b913cb82-fb5e-487b-a995-64273fc974fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07dd8d6-902d-4319-a756-398aea81091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07dd8d6-902d-4319-a756-398aea81091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78dc7b33-6deb-4302-a16a-e77b07782c19', 'volume_name': 'volume-78dc7b33-6deb-4302-a16a-e77b07782c19', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a5fe2f-c82b-4ce5-bd23-7e2d5413c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a5fe2f-c82b-4ce5-bd23-7e2d5413c72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae5411d-6c89-4904-8fdd-dbe436fcec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:21 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Volume 78dc7b33-6deb-4302-a16a-e77b07782c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78dc7b33-6deb-4302-a16a-e77b07782c19', 'volume_size': 1}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-508855196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78dc7b33-6deb-4302-a16a-e77b07782c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7325a4347b39498fa3253f6d2c101fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:21Z,use_quota=True,user_id='da109bda0fe94b61b4c1b1f494016741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Creating volume 78dc7b33-6deb-4302-a16a-e77b07782c19 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:21 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:22 devstack sudo[91864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19 1073741824
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:22 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (68fb08c6-6104-499a-8386-e4298658258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45e19e2-d71e-44ba-95d1-5dbd8b03c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45e19e2-d71e-44ba-95d1-5dbd8b03c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-513329592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0862304-0783-477d-8b62-db3c58037c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e95e019b56e45338f1353c896253f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:22Z,use_quota=True,user_id='a45cc9d9f1fd49b593cc1964c6cd4b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3344673-b1b2-4f27-80f5-4a53d84d9b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3344673-b1b2-4f27-80f5-4a53d84d9b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e7131d-8050-4c58-8a81-885e5d7befcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e7131d-8050-4c58-8a81-885e5d7befcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0862304-0783-477d-8b62-db3c58037c81', 'volume_name': 'volume-e0862304-0783-477d-8b62-db3c58037c81', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0c1475-e98d-45c0-a44b-d376591a7e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0c1475-e98d-45c0-a44b-d376591a7e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b89697-5326-45df-863c-ab2191f24729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:22 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Volume e0862304-0783-477d-8b62-db3c58037c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0862304-0783-477d-8b62-db3c58037c81', 'volume_size': 1}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-16104d7d-40d6-4a4f-a0bf-52b5abed866f tempest-ServerActionsTestOtherA-452165374 None] Terminate volume connection completed successfully.
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-16104d7d-40d6-4a4f-a0bf-52b5abed866f tempest-ServerActionsTestOtherA-452165374 None] Deleting attachment 459c2622-9efa-407c-86fb-1eee175977ae. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "cinder-6ca9d928-b911-44e0-a80e-f5ccc0d7b233-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Lock "cinder-6ca9d928-b911-44e0-a80e-f5ccc0d7b233-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "cinder-quobyte-6ca9d928-b911-44e0-a80e-f5ccc0d7b233" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Lock "cinder-quobyte-6ca9d928-b911-44e0-a80e-f5ccc0d7b233" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c814b85c-0273-43f8-8c44-a6aeaa870ea5]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:22 devstack sudo[91872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233
Aug 29 13:14:22 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:23 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19 1073741824" returned: 0 in 1.090s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:23 devstack sudo[91874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19
Aug 29 13:14:23 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:23 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233" returned: 0 in 0.492s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:23 devstack sudo[91879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233
Aug 29 13:14:23 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:23 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19" returned: 0 in 0.375s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.340s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-513329592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0862304-0783-477d-8b62-db3c58037c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e95e019b56e45338f1353c896253f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:22Z,use_quota=True,user_id='a45cc9d9f1fd49b593cc1964c6cd4b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Creating volume e0862304-0783-477d-8b62-db3c58037c81 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:23 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae5411d-6c89-4904-8fdd-dbe436fcec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78dc7b33-6deb-4302-a16a-e77b07782c19', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf44993-5bdc-495c-895d-9956f3e55fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:23 devstack sudo[91882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81 1073741824
Aug 29 13:14:23 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:23 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Volume volume-78dc7b33-6deb-4302-a16a-e77b07782c19 (78dc7b33-6deb-4302-a16a-e77b07782c19): created successfully
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf44993-5bdc-495c-895d-9956f3e55fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Flow 'volume_create_manager' (7e0a9b6e-de48-4343-9079-dbed6ffd9339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3946fe0d-fee5-4b41-b4da-b705fba7daf3 tempest-AttachVolumeNegativeTest-583345777 None] Created volume successfully.
Aug 29 13:14:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "cinder-6483c99f-7eac-4f88-bc68-85484509e468-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:24 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Lock "cinder-6483c99f-7eac-4f88-bc68-85484509e468-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ca9d928-b911-44e0-a80e-f5ccc0d7b233" returned: 0 in 0.719s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Lock "cinder-quobyte-6ca9d928-b911-44e0-a80e-f5ccc0d7b233" released by "delete_volume" :: held 1.321s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "cinder-quobyte-6483c99f-7eac-4f88-bc68-85484509e468" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Lock "cinder-quobyte-6483c99f-7eac-4f88-bc68-85484509e468" acquired by "delete_volume" :: waited 0.052s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5b7471-2c94-443c-8824-198241c75734]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG cinder.quota [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Created reservations ['683d6503-32d4-4f28-9555-e7c10b79c215', '84df1615-ff87-4c90-8b72-18ddb3fb0710', '99b7e6ee-0c90-40f2-90a9-e114d004968c', '2cec136d-dd68-4ba5-8c46-f3f8693ed5e7'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:24 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468
Aug 29 13:14:24 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:24 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81 1073741824" returned: 0 in 0.905s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:24 devstack sudo[91914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:24 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:24 devstack sudo[91916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81
Aug 29 13:14:24 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:25 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468" returned: 0 in 0.793s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:25 devstack sudo[91928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468
Aug 29 13:14:25 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:25 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.608s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.manager [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Deleted volume successfully.
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-3d34ca9f-fcd2-4d11-9435-9b6395781968 req-ce124cdc-5f98-470b-b527-1e62e8d3c087 tempest-ServerActionsTestOtherA-452165374 None] Lock "cinder-6ca9d928-b911-44e0-a80e-f5ccc0d7b233-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:25 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81" returned: 0 in 0.640s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b89697-5326-45df-863c-ab2191f24729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0862304-0783-477d-8b62-db3c58037c81', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb4d5a6-9f9d-4323-a33a-da35ab3e192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:25 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Volume volume-e0862304-0783-477d-8b62-db3c58037c81 (e0862304-0783-477d-8b62-db3c58037c81): created successfully
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb4d5a6-9f9d-4323-a33a-da35ab3e192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (68fb08c6-6104-499a-8386-e4298658258a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6de41123-8362-4855-be23-5310ff82168e tempest-VolumesSnapshotTestJSON-1145731193 None] Created volume successfully.
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6483c99f-7eac-4f88-bc68-85484509e468" returned: 0 in 0.515s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:25 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Lock "cinder-quobyte-6483c99f-7eac-4f88-bc68-85484509e468" released by "delete_volume" :: held 1.380s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Created reservations ['3b6370a7-17fe-44fa-91e1-53967dca300f', '7b6a0040-bf71-4579-b130-2c880d7bd08a', 'e502647b-38fc-46ab-9d1a-590f66b2a3bf', 'f635c94c-e096-46f7-8240-ac61509e35be'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:26 devstack sudo[91969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:26 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-614478a7-02ba-4e94-ab93-b78b9e07189b req-0bfa8e29-2bda-4583-a631-54641c4b07e7 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-614478a7-02ba-4e94-ab93-b78b9e07189b req-0bfa8e29-2bda-4583-a631-54641c4b07e7 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-614478a7-02ba-4e94-ab93-b78b9e07189b req-0bfa8e29-2bda-4583-a631-54641c4b07e7 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-614478a7-02ba-4e94-ab93-b78b9e07189b req-0bfa8e29-2bda-4583-a631-54641c4b07e7 tempest-AttachVolumeNegativeTest-583345777 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-78dc7b33-6deb-4302-a16a-e77b07782c19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e6840cf-ecda-42d6-af1a-8e9db96de2e5', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:14:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-614478a7-02ba-4e94-ab93-b78b9e07189b req-0bfa8e29-2bda-4583-a631-54641c4b07e7 tempest-AttachVolumeNegativeTest-583345777 None] attachment_update completed successfully.
Aug 29 13:14:26 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.633s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:26 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Deleted volume successfully.
Aug 29 13:14:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0e45976c-2164-4c82-a77d-4308b21d80b0 tempest-ServerActionsTestOtherA-452165374 None] Lock "cinder-6483c99f-7eac-4f88-bc68-85484509e468-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Creating offline snapshot 875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 of volume e0862304-0783-477d-8b62-db3c58037c81 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:14:27 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8405e4d-a213-41dc-a67f-acbb466f41e7]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:27 devstack sudo[92376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81
Aug 29 13:14:27 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:28 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81" returned: 0 in 0.731s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:28 devstack sudo[92409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 1G
Aug 29 13:14:28 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:28 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 1G" returned: 0 in 0.895s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0862304-0783-477d-8b62-db3c58037c81 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:28 devstack sudo[92428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0862304-0783-477d-8b62-db3c58037c81 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18
Aug 29 13:14:28 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:29 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0862304-0783-477d-8b62-db3c58037c81 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18" returned: 0 in 0.515s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:29 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 is being set with open permissions: ugo+rw
Aug 29 13:14:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:29 devstack sudo[92434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18
Aug 29 13:14:29 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:29 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18" returned: 0 in 0.566s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:30 devstack sudo[92439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.info
Aug 29 13:14:30 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:30 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.info" returned: 0 in 0.408s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:30 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.info is being set with open permissions: ugo+rw
Aug 29 13:14:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:30 devstack sudo[92444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.info
Aug 29 13:14:30 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:30 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-d1660837-4bf8-4b73-a03a-5649bbff16e7 req-298e9155-f4f2-4a42-966f-1ee231769cd6 tempest-AttachVolumeNegativeTest-583345777 None] Terminate volume connection completed successfully.
Aug 29 13:14:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-d1660837-4bf8-4b73-a03a-5649bbff16e7 req-298e9155-f4f2-4a42-966f-1ee231769cd6 tempest-AttachVolumeNegativeTest-583345777 None] Deleting attachment 5e6840cf-ecda-42d6-af1a-8e9db96de2e5. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:14:31 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.info" returned: 0 in 0.659s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:31 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1a60e198-28e6-4492-9288-751e5e695304 tempest-VolumesSnapshotTestJSON-1145731193 None] Create snapshot completed successfully
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-875b2f77-b3c1-4deb-a8d7-b6cb1044bf18-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-875b2f77-b3c1-4deb-a8d7-b6cb1044bf18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-e0862304-0783-477d-8b62-db3c58037c81" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-e0862304-0783-477d-8b62-db3c58037c81" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-875b2f77-b3c1-4deb-a8d7-b6cb1044bf18" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-875b2f77-b3c1-4deb-a8d7-b6cb1044bf18" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Deleting offline snapshot 875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 of volume e0862304-0783-477d-8b62-db3c58037c81 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] snapshot_file for this snap is: volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:14:31 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26aa3b4-4403-40b9-b51d-4630920ba3e5]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:32 devstack sudo[92508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18
Aug 29 13:14:32 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:32 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18" returned: 0 in 0.639s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0862304-0783-477d-8b62-db3c58037c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:14:32 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7f322c-6725-4df3-bc8d-66641106f306]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:32 devstack sudo[92525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81
Aug 29 13:14:32 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:33 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81" returned: 0 in 0.466s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:33 devstack sudo[92531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18
Aug 29 13:14:33 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:33 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18" returned: 0 in 0.427s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:33 devstack sudo[92538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18
Aug 29 13:14:33 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:33 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81.875b2f77-b3c1-4deb-a8d7-b6cb1044bf18" returned: 0 in 0.332s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-875b2f77-b3c1-4deb-a8d7-b6cb1044bf18" released by "_delete_snapshot" :: held 2.071s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-e0862304-0783-477d-8b62-db3c58037c81" released by "delete_snapshot" :: held 2.110s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:34 devstack cinder-volume[85771]: WARNING cinder.quota [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:14:34 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Created reservations ['d45d9daa-528c-4afb-8ac5-bb5f57ce61d9', '9942bac5-f60c-4555-a3b9-623fee1fec98', '143eb98c-2859-490c-aa66-5feba5fcd7ba', 'a6dd3076-0683-4798-868a-453a79a4e843'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Delete snapshot completed successfully.
Aug 29 13:14:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2c14852c-90bc-4ef8-9437-b79c81117c99 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-875b2f77-b3c1-4deb-a8d7-b6cb1044bf18-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Flow 'volume_create_manager' (c254d36b-880b-4fd0-9358-8ec8157954b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c04464-fb08-4c9a-a80a-1b62d9fb6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c04464-fb08-4c9a-a80a-1b62d9fb6195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1569100976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83ba55a-658f-4d75-9ddf-76ca66602d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8665c5399ba84951b8289be056786e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:35Z,use_quota=True,user_id='6be8f688fca8458999eaf21eae0972ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68b4026-b9a5-4c70-8b94-522d085d4d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68b4026-b9a5-4c70-8b94-522d085d4d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec34ac7-aabb-46fe-a59d-43145eaabee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec34ac7-aabb-46fe-a59d-43145eaabee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83ba55a-658f-4d75-9ddf-76ca66602d28', 'volume_name': 'volume-d83ba55a-658f-4d75-9ddf-76ca66602d28', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b03924-7a94-4c8a-a9dd-30e5a28e13ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b03924-7a94-4c8a-a9dd-30e5a28e13ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adad3cbc-771c-4d66-9e37-71a2f6ca2f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:35 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Volume d83ba55a-658f-4d75-9ddf-76ca66602d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83ba55a-658f-4d75-9ddf-76ca66602d28', 'volume_size': 1}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1569100976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83ba55a-658f-4d75-9ddf-76ca66602d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8665c5399ba84951b8289be056786e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:35Z,use_quota=True,user_id='6be8f688fca8458999eaf21eae0972ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Creating volume d83ba55a-658f-4d75-9ddf-76ca66602d28 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:35 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:35 devstack sudo[92543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28 1073741824
Aug 29 13:14:35 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (2096f92c-c53e-4cc1-80c5-020a4278a302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf132b44-4453-4a9e-95ac-bb68f2ced0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf132b44-4453-4a9e-95ac-bb68f2ced0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1961245591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9acf075-11f2-4278-a898-578c846c07b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e95e019b56e45338f1353c896253f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:36Z,use_quota=True,user_id='a45cc9d9f1fd49b593cc1964c6cd4b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd75479-ec87-49e1-ac4a-8ab0b0e68dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd75479-ec87-49e1-ac4a-8ab0b0e68dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49891167-bc38-4b34-9bcc-a22b5d0c1fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49891167-bc38-4b34-9bcc-a22b5d0c1fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9acf075-11f2-4278-a898-578c846c07b8', 'volume_name': 'volume-e9acf075-11f2-4278-a898-578c846c07b8', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c8ad9e-98e3-4987-bbf7-ddab64ea0c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c8ad9e-98e3-4987-bbf7-ddab64ea0c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a57a2ba-0dec-44c5-bf37-78ef4675bb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:36 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume e9acf075-11f2-4278-a898-578c846c07b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9acf075-11f2-4278-a898-578c846c07b8', 'volume_size': 1}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:36 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28 1073741824" returned: 0 in 0.580s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:36 devstack sudo[92550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28
Aug 29 13:14:36 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:36 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28" returned: 0 in 0.264s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1961245591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9acf075-11f2-4278-a898-578c846c07b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e95e019b56e45338f1353c896253f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:36Z,use_quota=True,user_id='a45cc9d9f1fd49b593cc1964c6cd4b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Creating volume e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:36 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adad3cbc-771c-4d66-9e37-71a2f6ca2f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83ba55a-658f-4d75-9ddf-76ca66602d28', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:36 devstack sudo[92553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 1073741824
Aug 29 13:14:36 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3150a2-0aa5-41c9-ba05-ed26e47a6eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:36 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Volume volume-d83ba55a-658f-4d75-9ddf-76ca66602d28 (d83ba55a-658f-4d75-9ddf-76ca66602d28): created successfully
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3150a2-0aa5-41c9-ba05-ed26e47a6eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Flow 'volume_create_manager' (c254d36b-880b-4fd0-9358-8ec8157954b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "cinder-78dc7b33-6deb-4302-a16a-e77b07782c19-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:36 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8c519b3d-e5f8-411b-80c9-698b6b160b05 tempest-ServersNegativeTestJSON-871584209 None] Created volume successfully.
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-78dc7b33-6deb-4302-a16a-e77b07782c19-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "cinder-quobyte-78dc7b33-6deb-4302-a16a-e77b07782c19" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-quobyte-78dc7b33-6deb-4302-a16a-e77b07782c19" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37aa550-024c-4d05-b7e5-c2d84407628f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:37 devstack sudo[92555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19
Aug 29 13:14:37 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:37 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 1073741824" returned: 0 in 0.510s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:37 devstack sudo[92563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8
Aug 29 13:14:37 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:37 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19" returned: 0 in 0.422s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:37 devstack sudo[92566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19
Aug 29 13:14:37 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:37 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8" returned: 0 in 0.321s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a57a2ba-0dec-44c5-bf37-78ef4675bb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9acf075-11f2-4278-a898-578c846c07b8', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c993126-89a4-48cf-961b-8aa4ecb8ffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:37 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume volume-e9acf075-11f2-4278-a898-578c846c07b8 (e9acf075-11f2-4278-a898-578c846c07b8): created successfully
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c993126-89a4-48cf-961b-8aa4ecb8ffdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (2096f92c-c53e-4cc1-80c5-020a4278a302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:37 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c273de24-370d-4e81-a109-ed64058a1bd6 tempest-VolumesSnapshotTestJSON-1145731193 None] Created volume successfully.
Aug 29 13:14:37 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-78dc7b33-6deb-4302-a16a-e77b07782c19" returned: 0 in 0.336s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-quobyte-78dc7b33-6deb-4302-a16a-e77b07782c19" released by "delete_volume" :: held 0.813s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Created reservations ['231f0697-e57d-4fa1-af49-07159a15e305', '23d4d892-0627-4f59-9831-26331de4918f', 'bdbf5560-4985-456f-8933-5c3a1e57c19d', '67642fd3-7b67-4ac4-a9fc-a47d4b2b41f1'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:37 devstack sudo[92571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:37 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:38 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.305s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Deleted volume successfully.
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ea029892-d184-4333-8174-e43fda02b6f1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-78dc7b33-6deb-4302-a16a-e77b07782c19-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "cinder-a01ea232-c2fa-498b-accf-cb195b6a2860-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-a01ea232-c2fa-498b-accf-cb195b6a2860-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "cinder-quobyte-a01ea232-c2fa-498b-accf-cb195b6a2860" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-quobyte-a01ea232-c2fa-498b-accf-cb195b6a2860" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1922170b-b8aa-4ded-91ff-838c9b0083d1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Creating offline snapshot 42cc6ab3-5291-47c5-af00-f8f455cf84bc of volume e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b2fad-058e-44ec-bad0-4a91540b3d1f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:38 devstack sudo[92574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860
Aug 29 13:14:38 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:38 devstack sudo[92575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8
Aug 29 13:14:38 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:38 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860" returned: 0 in 0.506s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:38 devstack sudo[92582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860
Aug 29 13:14:38 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:39 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8" returned: 0 in 0.711s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:39 devstack sudo[92587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc 1G
Aug 29 13:14:39 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Flow 'volume_create_manager' (42469347-f974-4975-86d1-e582c5d0a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175c6046-989d-4df4-9a36-f608b45bc087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175c6046-989d-4df4-9a36-f608b45bc087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1924089301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c2ee05-9896-44a6-a5cf-fb064c41d385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8665c5399ba84951b8289be056786e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:39Z,use_quota=True,user_id='6be8f688fca8458999eaf21eae0972ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef72c8eb-b0e4-4dd2-b7a1-58a6e527e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef72c8eb-b0e4-4dd2-b7a1-58a6e527e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dac7fc6-ba7b-48df-800b-1c5607a122a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dac7fc6-ba7b-48df-800b-1c5607a122a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c2ee05-9896-44a6-a5cf-fb064c41d385', 'volume_name': 'volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b01013-2373-48fe-9058-b2e41541bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b01013-2373-48fe-9058-b2e41541bd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8172adfb-61bc-452c-aab6-bec3ae21a73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:39 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Volume c0c2ee05-9896-44a6-a5cf-fb064c41d385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385', 'volume_size': 1}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:39 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a01ea232-c2fa-498b-accf-cb195b6a2860" returned: 0 in 0.477s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-quobyte-a01ea232-c2fa-498b-accf-cb195b6a2860" released by "delete_volume" :: held 1.058s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Created reservations ['eb4d889c-dd8c-489c-b9f0-59525587f28e', '2a0bac4d-3024-4022-8ccd-99cce09b7bdf', 'c30c7959-eb6a-4c4f-a072-78b27a5dd584', '2322b440-ca7e-40f3-8a6c-7851236d9931'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:39 devstack sudo[92600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:39 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:39 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc 1G" returned: 0 in 0.516s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9acf075-11f2-4278-a898-578c846c07b8 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:39 devstack sudo[92602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9acf075-11f2-4278-a898-578c846c07b8 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc
Aug 29 13:14:39 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:39 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.336s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:39 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Deleted volume successfully.
Aug 29 13:14:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d6128d1-4cf0-4c50-8469-2bd6fd6426d1 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-a01ea232-c2fa-498b-accf-cb195b6a2860-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:39 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9acf075-11f2-4278-a898-578c846c07b8 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc" returned: 0 in 0.354s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:40 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc is being set with open permissions: ugo+rw
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:40 devstack sudo[92610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc
Aug 29 13:14:40 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:40 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc" returned: 0 in 0.268s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:40 devstack sudo[92613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.info
Aug 29 13:14:40 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:40 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.info" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:40 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.info is being set with open permissions: ugo+rw
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:40 devstack sudo[92616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.info
Aug 29 13:14:40 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "cinder-892ad205-c29b-4394-8c6e-c123abf619b9-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-892ad205-c29b-4394-8c6e-c123abf619b9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "cinder-quobyte-892ad205-c29b-4394-8c6e-c123abf619b9" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-quobyte-892ad205-c29b-4394-8c6e-c123abf619b9" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce45893e-583e-45c4-827a-f3f169f7bdc6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:40 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.info" returned: 0 in 0.294s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.606s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:40 devstack sudo[92618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1924089301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c2ee05-9896-44a6-a5cf-fb064c41d385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8665c5399ba84951b8289be056786e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:39Z,use_quota=True,user_id='6be8f688fca8458999eaf21eae0972ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Creating volume c0c2ee05-9896-44a6-a5cf-fb064c41d385 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:40 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:40 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:40 devstack sudo[92621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385 1073741824
Aug 29 13:14:40 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-94a14360-dc8b-47ab-92ba-2936784e7852 tempest-VolumesSnapshotTestJSON-1145731193 None] Create snapshot completed successfully
Aug 29 13:14:41 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9" returned: 0 in 0.414s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:41 devstack sudo[92629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9
Aug 29 13:14:41 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:41 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385 1073741824" returned: 0 in 0.465s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:41 devstack sudo[92632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385
Aug 29 13:14:41 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:41 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-892ad205-c29b-4394-8c6e-c123abf619b9" returned: 0 in 0.304s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-quobyte-892ad205-c29b-4394-8c6e-c123abf619b9" released by "delete_volume" :: held 0.773s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Created reservations ['937e3804-99bb-4fa5-98a1-33ec70854882', 'ac3c6e8d-5ffa-4ffa-b941-811de45d84c8', 'e4feab05-57ff-44f1-92cd-624bd9b9c340', 'c46ce6df-43b3-48c7-8fdc-43f2e5eb1b02'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:41 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385" returned: 0 in 0.282s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8172adfb-61bc-452c-aab6-bec3ae21a73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da32b25-db48-4602-9806-cf749524ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:41 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Volume volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385 (c0c2ee05-9896-44a6-a5cf-fb064c41d385): created successfully
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da32b25-db48-4602-9806-cf749524ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Flow 'volume_create_manager' (42469347-f974-4975-86d1-e582c5d0a067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7da10bd4-918c-461e-a14e-d231fc155940 tempest-ServersNegativeTestJSON-871584209 None] Created volume successfully.
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:41 devstack sudo[92636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:41 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:42 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.336s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:42 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Deleted volume successfully.
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3dac7ffc-4fc4-4a7d-bd6b-7dda7bc47743 tempest-AttachVolumeNegativeTest-583345777 None] Lock "cinder-892ad205-c29b-4394-8c6e-c123abf619b9-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (89a8a654-7b61-49ed-8cfa-ee515c37d268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b57039b-9be7-4f13-9c65-3cadfccdb86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b57039b-9be7-4f13-9c65-3cadfccdb86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1734878576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee39472e-1876-45d2-b2d8-86b40eee3620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e95e019b56e45338f1353c896253f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=42cc6ab3-5291-47c5-af00-f8f455cf84bc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:42Z,use_quota=True,user_id='a45cc9d9f1fd49b593cc1964c6cd4b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9d4ef4-f0dd-4a06-a5e6-40726c8f5847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9d4ef4-f0dd-4a06-a5e6-40726c8f5847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a5207e-cba9-4636-907e-ab677cc2ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a5207e-cba9-4636-907e-ab677cc2ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee39472e-1876-45d2-b2d8-86b40eee3620', 'volume_name': 'volume-ee39472e-1876-45d2-b2d8-86b40eee3620', 'volume_size': 2, 'snapshot_id': '42cc6ab3-5291-47c5-af00-f8f455cf84bc'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1f0776-fe05-47bc-bc3c-7ba32ad710c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1f0776-fe05-47bc-bc3c-7ba32ad710c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6a63a0-1e55-4af7-8504-6db554520f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:42 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume ee39472e-1876-45d2-b2d8-86b40eee3620: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee39472e-1876-45d2-b2d8-86b40eee3620', 'volume_size': 2, 'snapshot_id': '42cc6ab3-5291-47c5-af00-f8f455cf84bc'}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-42cc6ab3-5291-47c5-af00-f8f455cf84bc-ee39472e-1876-45d2-b2d8-86b40eee3620" by "_create_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-42cc6ab3-5291-47c5-af00-f8f455cf84bc-ee39472e-1876-45d2-b2d8-86b40eee3620" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Creating volume ee39472e-1876-45d2-b2d8-86b40eee3620 from snapshot 42cc6ab3-5291-47c5-af00-f8f455cf84bc {{(pid=85771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-ee39472e-1876-45d2-b2d8-86b40eee3620" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-ee39472e-1876-45d2-b2d8-86b40eee3620" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] snapshot: 42cc6ab3-5291-47c5-af00-f8f455cf84bc, volume: ee39472e-1876-45d2-b2d8-86b40eee3620,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe787cf8-0545-481b-b8d4-baa8c73930c4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:42 devstack sudo[92640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc
Aug 29 13:14:42 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "cinder-c0c2ee05-9896-44a6-a5cf-fb064c41d385-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Lock "cinder-c0c2ee05-9896-44a6-a5cf-fb064c41d385-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "cinder-quobyte-c0c2ee05-9896-44a6-a5cf-fb064c41d385" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Lock "cinder-quobyte-c0c2ee05-9896-44a6-a5cf-fb064c41d385" acquired by "delete_volume" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:43 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc" returned: 0 in 0.557s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9acf075-11f2-4278-a898-578c846c07b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3259eb7-7303-4b66-ab7b-7b0fa341cea2]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1790eb-2543-4bab-acdc-1eb0269fdb47]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:43 devstack sudo[92647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8
Aug 29 13:14:43 devstack sudo[92646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385
Aug 29 13:14:43 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:43 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Flow 'volume_create_manager' (db19ce18-d101-4db8-923c-ed67f51e6e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52002ca6-aef9-4a22-aaf8-defcce58f30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52002ca6-aef9-4a22-aaf8-defcce58f30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1644554329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdbf463fd4144187ad0c0bb9e408e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:44Z,use_quota=True,user_id='295d3572dc724064b9b60ece51f5f23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd631e4-e8e0-4209-ac0c-b910c186a3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd631e4-e8e0-4209-ac0c-b910c186a3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137f1b7f-d098-4bc7-926b-8813b3f7bf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137f1b7f-d098-4bc7-926b-8813b3f7bf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849', 'volume_name': 'volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c264bb-1514-463a-bdb0-cb7cd5f9eb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c264bb-1514-463a-bdb0-cb7cd5f9eb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c773d0c-7aa6-4710-82ae-02a9f87e2b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:43 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Volume de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849', 'volume_size': 1}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:43 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8" returned: 0 in 0.507s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620 not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:43 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385" returned: 0 in 0.541s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:43 devstack sudo[92658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620
Aug 29 13:14:43 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:43 devstack sudo[92659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385
Aug 29 13:14:43 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:44 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0c2ee05-9896-44a6-a5cf-fb064c41d385" returned: 0 in 0.275s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Lock "cinder-quobyte-c0c2ee05-9896-44a6-a5cf-fb064c41d385" released by "delete_volume" :: held 0.879s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Created reservations ['96135068-b093-4e04-8107-5927750a1c70', '479efead-bd76-418d-95a5-7516f1ab0486', '9ac64899-807b-4da2-b1e1-876b851a55ec', 'bc23036f-f54d-46c8-b9f2-e09200178013'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:44 devstack sudo[92667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:44 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "cinder-d83ba55a-658f-4d75-9ddf-76ca66602d28-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Lock "cinder-d83ba55a-658f-4d75-9ddf-76ca66602d28-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "cinder-quobyte-d83ba55a-658f-4d75-9ddf-76ca66602d28" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Lock "cinder-quobyte-d83ba55a-658f-4d75-9ddf-76ca66602d28" acquired by "delete_volume" :: waited 0.038s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a0a68e-4da9-4a15-8eb3-1eeda8a2d019]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:44 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.716s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:44 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:44 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Deleted volume successfully.
Aug 29 13:14:44 devstack sudo[92688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28
Aug 29 13:14:44 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8c21f83d-e7b5-4de7-8075-61d0146b54c1 tempest-ServersNegativeTestJSON-871584209 None] Lock "cinder-c0c2ee05-9896-44a6-a5cf-fb064c41d385-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:45 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28" returned: 0 in 1.158s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:45 devstack sudo[92694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28
Aug 29 13:14:45 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:46 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d83ba55a-658f-4d75-9ddf-76ca66602d28" returned: 0 in 0.506s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Lock "cinder-quobyte-d83ba55a-658f-4d75-9ddf-76ca66602d28" released by "delete_volume" :: held 1.809s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:46 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Created reservations ['376c1734-b702-4423-95d5-611bf61653f2', 'abab4f68-810d-49e8-809d-111d5e4cdf6d', '9548b6fc-a9b5-412e-9b73-5de1fa257a90', '8abcaea1-9d56-4901-ac0a-cbba09f58ca4'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:46 devstack sudo[92698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:46 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:47 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.533s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:47 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:47 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Deleted volume successfully.
Aug 29 13:14:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4c2d126b-f2be-4a68-a7e9-8ddb9cb20614 tempest-ServersNegativeTestJSON-871584209 None] Lock "cinder-d83ba55a-658f-4d75-9ddf-76ca66602d28-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:49 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620" returned: 0 in 6.073s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:49 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:14:49 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Converted 1024.00 MB image at 168.59 MB/s
Aug 29 13:14:49 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620 is being set with open permissions: ugo+rw
Aug 29 13:14:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:49 devstack sudo[92725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620
Aug 29 13:14:49 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:50 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-ee39472e-1876-45d2-b2d8-86b40eee3620" released by "_copy_volume_from_snapshot" :: held 7.595s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-42cc6ab3-5291-47c5-af00-f8f455cf84bc-ee39472e-1876-45d2-b2d8-86b40eee3620" released by "_create_volume_from_snapshot" :: held 7.684s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.704s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.491s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1644554329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdbf463fd4144187ad0c0bb9e408e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:44Z,use_quota=True,user_id='295d3572dc724064b9b60ece51f5f23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Creating volume de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:50 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6a63a0-1e55-4af7-8504-6db554520f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee39472e-1876-45d2-b2d8-86b40eee3620', 'volume_size': 2, 'snapshot_id': '42cc6ab3-5291-47c5-af00-f8f455cf84bc'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193d217c-aecf-4eb0-b311-634d678cdbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:50 devstack sudo[92729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849 1073741824
Aug 29 13:14:50 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:50 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume volume-ee39472e-1876-45d2-b2d8-86b40eee3620 (ee39472e-1876-45d2-b2d8-86b40eee3620): created successfully
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193d217c-aecf-4eb0-b311-634d678cdbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (89a8a654-7b61-49ed-8cfa-ee515c37d268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:50 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4669c516-d608-4762-8376-4b813be87e72 tempest-VolumesSnapshotTestJSON-1145731193 None] Created volume successfully.
Aug 29 13:14:50 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849 1073741824" returned: 0 in 0.600s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:50 devstack sudo[92737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849
Aug 29 13:14:50 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:51 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c773d0c-7aa6-4710-82ae-02a9f87e2b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2caefd-bbe0-43b3-810a-34c9d7cd1215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:51 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Volume volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849 (de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849): created successfully
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2caefd-bbe0-43b3-810a-34c9d7cd1215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Flow 'volume_create_manager' (db19ce18-d101-4db8-923c-ed67f51e6e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:51 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2a540575-f093-4774-8121-bb290c4190f9 tempest-VolumesTestJSON-137943415 None] Created volume successfully.
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-ee39472e-1876-45d2-b2d8-86b40eee3620-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-ee39472e-1876-45d2-b2d8-86b40eee3620-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-ee39472e-1876-45d2-b2d8-86b40eee3620" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-ee39472e-1876-45d2-b2d8-86b40eee3620" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f19498e-91f5-4f0e-8540-fae918e1eb4e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:51 devstack sudo[92740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620
Aug 29 13:14:51 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:52 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620" returned: 0 in 0.496s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:52 devstack sudo[92746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620
Aug 29 13:14:52 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Flow 'volume_create_manager' (3e182179-befb-48e0-b25f-f409cf39718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ee6076-0f87-47de-944c-3f4710245298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ee6076-0f87-47de-944c-3f4710245298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-153582953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74062ff2-d35c-407e-a0c6-ad60635d4ffe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdbf463fd4144187ad0c0bb9e408e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:52Z,use_quota=True,user_id='295d3572dc724064b9b60ece51f5f23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb0a1a4-3ccf-4d86-9e59-2e85c50425c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb0a1a4-3ccf-4d86-9e59-2e85c50425c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f29739e-506e-4c95-8851-071c931607de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f29739e-506e-4c95-8851-071c931607de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74062ff2-d35c-407e-a0c6-ad60635d4ffe', 'volume_name': 'volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd68df3-5717-4b59-84f2-2bc842707dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd68df3-5717-4b59-84f2-2bc842707dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f3daa5-93ec-44fc-92e7-d31ac008f6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Volume 74062ff2-d35c-407e-a0c6-ad60635d4ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe', 'volume_size': 1}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-153582953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74062ff2-d35c-407e-a0c6-ad60635d4ffe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdbf463fd4144187ad0c0bb9e408e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:52Z,use_quota=True,user_id='295d3572dc724064b9b60ece51f5f23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Creating volume 74062ff2-d35c-407e-a0c6-ad60635d4ffe {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:52 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:52 devstack sudo[92748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe 1073741824
Aug 29 13:14:52 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:52 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee39472e-1876-45d2-b2d8-86b40eee3620" returned: 0 in 0.401s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-ee39472e-1876-45d2-b2d8-86b40eee3620" released by "delete_volume" :: held 0.957s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Created reservations ['b2fa286a-51b4-4848-ad69-abf030873cc8', '0376ad53-6ed8-4fe7-8fec-201306186144', '5db50405-c7e9-499d-8b31-aede4854057f', 'b17380e3-488e-43ae-9f3f-69845d16bd84'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:52 devstack sudo[92755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:52 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:53 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe 1073741824" returned: 0 in 0.587s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:53 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.287s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Deleted volume successfully.
Aug 29 13:14:53 devstack sudo[92759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe
Aug 29 13:14:53 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11b69708-0bbc-4baf-931b-b8678d54bcef tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-ee39472e-1876-45d2-b2d8-86b40eee3620-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:53 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe" returned: 0 in 0.271s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f3daa5-93ec-44fc-92e7-d31ac008f6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa92df6f-9936-4274-a898-6a3bb573c8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Volume volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe (74062ff2-d35c-407e-a0c6-ad60635d4ffe): created successfully
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa92df6f-9936-4274-a898-6a3bb573c8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Flow 'volume_create_manager' (3e182179-befb-48e0-b25f-f409cf39718b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8fda5277-c73a-4cd3-8f61-9ea9b7bd00b6 tempest-VolumesTestJSON-137943415 None] Created volume successfully.
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-42cc6ab3-5291-47c5-af00-f8f455cf84bc-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-42cc6ab3-5291-47c5-af00-f8f455cf84bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-e9acf075-11f2-4278-a898-578c846c07b8" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-e9acf075-11f2-4278-a898-578c846c07b8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-42cc6ab3-5291-47c5-af00-f8f455cf84bc" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-42cc6ab3-5291-47c5-af00-f8f455cf84bc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Deleting offline snapshot 42cc6ab3-5291-47c5-af00-f8f455cf84bc of volume e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] snapshot_file for this snap is: volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d68749-873b-419f-865d-854ee2513d08]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:54 devstack sudo[92763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc
Aug 29 13:14:54 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Flow 'volume_create_manager' (e96987af-c420-4858-8e8b-2350f4c9b4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d41fce8-d826-4806-8dea-db36591ae403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d41fce8-d826-4806-8dea-db36591ae403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1966957281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b329bb0e-242c-4f00-8067-dccf24e507e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194fceea0fd9474c877cebf8625d50bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:54Z,use_quota=True,user_id='9e48489e679642ad9dbf6ffb96560554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c167af-d05e-482e-b18b-38971cb04660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c167af-d05e-482e-b18b-38971cb04660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178ece2c-1678-438f-b279-e9d327845e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178ece2c-1678-438f-b279-e9d327845e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b329bb0e-242c-4f00-8067-dccf24e507e8', 'volume_name': 'volume-b329bb0e-242c-4f00-8067-dccf24e507e8', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58ba2b2-e04e-4e3c-a20c-0ba4fb2af59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58ba2b2-e04e-4e3c-a20c-0ba4fb2af59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cdbe57a-cb6d-4120-a543-37d1638da5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:54 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Volume b329bb0e-242c-4f00-8067-dccf24e507e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b329bb0e-242c-4f00-8067-dccf24e507e8', 'volume_size': 1}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1966957281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b329bb0e-242c-4f00-8067-dccf24e507e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194fceea0fd9474c877cebf8625d50bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:54Z,use_quota=True,user_id='9e48489e679642ad9dbf6ffb96560554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Creating volume b329bb0e-242c-4f00-8067-dccf24e507e8 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:54 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:54 devstack sudo[92767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8 1073741824
Aug 29 13:14:54 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:54 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc" returned: 0 in 0.597s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9acf075-11f2-4278-a898-578c846c07b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:14:54 devstack sudo[92771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:54 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[153ec832-0979-420b-a1d3-8aca2505a774]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:54 devstack sudo[92773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8
Aug 29 13:14:54 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:55 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.395s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:55 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Flow 'volume_create_manager' (c3e026a4-44bb-41c5-b32c-6a9486f961b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0391d7d-a05e-4cfc-8b72-74f6619004f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8 1073741824" returned: 0 in 0.627s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0391d7d-a05e-4cfc-8b72-74f6619004f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-176092984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825290da-5845-43bd-b343-ff337e09d250,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdbf463fd4144187ad0c0bb9e408e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:55Z,use_quota=True,user_id='295d3572dc724064b9b60ece51f5f23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76702c0-cd74-49af-9c21-c53100177044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76702c0-cd74-49af-9c21-c53100177044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6157a4a8-6a2c-40c6-b7b6-5101d780eeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6157a4a8-6a2c-40c6-b7b6-5101d780eeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825290da-5845-43bd-b343-ff337e09d250', 'volume_name': 'volume-825290da-5845-43bd-b343-ff337e09d250', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c887e7e-4656-4d8d-b85d-7e9880a8353f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c887e7e-4656-4d8d-b85d-7e9880a8353f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465049ae-68e3-4492-944f-ae6217712623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:55 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Volume 825290da-5845-43bd-b343-ff337e09d250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825290da-5845-43bd-b343-ff337e09d250', 'volume_size': 1}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:55 devstack sudo[92782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8
Aug 29 13:14:55 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:55 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8" returned: 0 in 0.609s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:55 devstack sudo[92785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc
Aug 29 13:14:55 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:55 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8" returned: 0 in 0.297s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-176092984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825290da-5845-43bd-b343-ff337e09d250,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdbf463fd4144187ad0c0bb9e408e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:55Z,use_quota=True,user_id='295d3572dc724064b9b60ece51f5f23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Creating volume 825290da-5845-43bd-b343-ff337e09d250 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:55 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cdbe57a-cb6d-4120-a543-37d1638da5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b329bb0e-242c-4f00-8067-dccf24e507e8', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:55 devstack sudo[92790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250 1073741824
Aug 29 13:14:55 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49de577a-2aa7-4ffe-9a5e-5fc9b88c3e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:55 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Volume volume-b329bb0e-242c-4f00-8067-dccf24e507e8 (b329bb0e-242c-4f00-8067-dccf24e507e8): created successfully
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49de577a-2aa7-4ffe-9a5e-5fc9b88c3e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Flow 'volume_create_manager' (e96987af-c420-4858-8e8b-2350f4c9b4b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:55 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-b48e0279-fc0f-4359-9e06-f46a35fda2a2 req-82c44d07-c545-45d8-9c06-e861af942a9c tempest-VolumesSnapshotsTestJSON-1979336738 None] Created volume successfully.
Aug 29 13:14:55 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc" returned: 0 in 0.518s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:55 devstack sudo[92794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc
Aug 29 13:14:55 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:56 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250 1073741824" returned: 0 in 0.546s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:56 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8.42cc6ab3-5291-47c5-af00-f8f455cf84bc" returned: 0 in 0.327s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-42cc6ab3-5291-47c5-af00-f8f455cf84bc" released by "_delete_snapshot" :: held 2.203s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-e9acf075-11f2-4278-a898-578c846c07b8" released by "delete_snapshot" :: held 2.235s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:56 devstack sudo[92800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250
Aug 29 13:14:56 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Created reservations ['86849393-52e9-43d2-9e1c-b49c01ce7798', 'f7ab4204-0866-4915-bedc-a4c9ed1309cd', 'e959344a-25f6-41ed-ab5f-faca0cf57f13', '17432258-1008-406d-9983-d356ae888444'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Delete snapshot completed successfully.
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fef8719b-4c5d-4aeb-81f6-e8715c2b3993 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-42cc6ab3-5291-47c5-af00-f8f455cf84bc-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:56 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250" returned: 0 in 0.284s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465049ae-68e3-4492-944f-ae6217712623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825290da-5845-43bd-b343-ff337e09d250', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69d51c1-d807-4cf4-a926-0abf4b296cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:56 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Volume volume-825290da-5845-43bd-b343-ff337e09d250 (825290da-5845-43bd-b343-ff337e09d250): created successfully
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69d51c1-d807-4cf4-a926-0abf4b296cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Flow 'volume_create_manager' (c3e026a4-44bb-41c5-b32c-6a9486f961b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-af234373-571f-4cd3-9316-9cd5a941c787 tempest-VolumesTestJSON-137943415 None] Created volume successfully.
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Creating offline snapshot c8cc0606-833e-4185-87f7-3dc44c6ab1e9 of volume b329bb0e-242c-4f00-8067-dccf24e507e8 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eaf71c-2ac6-4493-959a-88e9a04cbb25]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:57 devstack sudo[92804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8
Aug 29 13:14:57 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-e9acf075-11f2-4278-a898-578c846c07b8-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-e9acf075-11f2-4278-a898-578c846c07b8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-e9acf075-11f2-4278-a898-578c846c07b8" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:57 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8" returned: 0 in 0.504s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-e9acf075-11f2-4278-a898-578c846c07b8" acquired by "delete_volume" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:57 devstack sudo[92809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 1G
Aug 29 13:14:57 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d14673-f132-4856-968e-fad6afedcf12]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:57 devstack sudo[92811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8
Aug 29 13:14:57 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:57 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8" returned: 0 in 0.448s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:57 devstack sudo[92820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8
Aug 29 13:14:57 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:57 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 1G" returned: 0 in 0.557s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b329bb0e-242c-4f00-8067-dccf24e507e8 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:58 devstack sudo[92822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b329bb0e-242c-4f00-8067-dccf24e507e8 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9
Aug 29 13:14:58 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:58 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9acf075-11f2-4278-a898-578c846c07b8" returned: 0 in 0.302s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-e9acf075-11f2-4278-a898-578c846c07b8" released by "delete_volume" :: held 0.836s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Created reservations ['f1d5c476-e319-4479-82e0-c228c308f559', '68a1801b-f975-4f4c-8cae-1a165f4bba4a', '7525cf82-6ce5-4856-bc49-5559dfc4cd1e', 'e545e393-a21c-4019-bb4b-97786f0f5acb'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:58 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b329bb0e-242c-4f00-8067-dccf24e507e8 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9" returned: 0 in 0.378s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:58 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 is being set with open permissions: ugo+rw
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:58 devstack sudo[92828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9
Aug 29 13:14:58 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:58 devstack sudo[92830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:58 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Acquiring lock "cinder-825290da-5845-43bd-b343-ff337e09d250-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Lock "cinder-825290da-5845-43bd-b343-ff337e09d250-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Acquiring lock "cinder-quobyte-825290da-5845-43bd-b343-ff337e09d250" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:14:58 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9" returned: 0 in 0.421s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Lock "cinder-quobyte-825290da-5845-43bd-b343-ff337e09d250" acquired by "delete_volume" :: waited 0.041s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6272362-d943-4258-8567-54e362dc87cb]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:58 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.422s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:58 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:14:58 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.info
Aug 29 13:14:58 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:58 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Deleted volume successfully.
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1359aed3-0be9-450a-a808-6cd8f7bcab5d tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-e9acf075-11f2-4278-a898-578c846c07b8-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:59 devstack sudo[92834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250
Aug 29 13:14:59 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:14:59 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (84a82955-0378-4fd3-9ac6-fdecc519497d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14ae7a8-164a-4552-98d6-d3499c29dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.info" returned: 0 in 0.411s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:59 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.info is being set with open permissions: ugo+rw
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:59 devstack sudo[92842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.info
Aug 29 13:14:59 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14ae7a8-164a-4552-98d6-d3499c29dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1160021964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f33b15-d68a-4e45-847a-334d3c68f298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e95e019b56e45338f1353c896253f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:59Z,use_quota=True,user_id='a45cc9d9f1fd49b593cc1964c6cd4b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3683f25-73d9-4e02-b009-fc81e0013535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3683f25-73d9-4e02-b009-fc81e0013535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75af8ad-c244-4b1b-8057-9daa15b89104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75af8ad-c244-4b1b-8057-9daa15b89104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f33b15-d68a-4e45-847a-334d3c68f298', 'volume_name': 'volume-84f33b15-d68a-4e45-847a-334d3c68f298', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ef46bf-5534-45b9-a75c-1fd47bd5a572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ef46bf-5534-45b9-a75c-1fd47bd5a572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6514777-17cc-46b3-8b62-1e114c962a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:14:59 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume 84f33b15-d68a-4e45-847a-334d3c68f298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f33b15-d68a-4e45-847a-334d3c68f298', 'volume_size': 1}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:59 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250" returned: 0 in 0.538s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:59 devstack sudo[92845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250
Aug 29 13:14:59 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:59 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.info" returned: 0 in 0.274s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.229s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1160021964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f33b15-d68a-4e45-847a-334d3c68f298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e95e019b56e45338f1353c896253f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:14:59Z,use_quota=True,user_id='a45cc9d9f1fd49b593cc1964c6cd4b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Creating volume 84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:14:59 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:59 devstack sudo[92849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 1073741824
Aug 29 13:14:59 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:14:59 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-825290da-5845-43bd-b343-ff337e09d250" returned: 0 in 0.291s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:14:59 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-e8f034d9-2ea1-493d-ab4f-08c89f8cd716 req-24bf326c-df6e-4ed8-a4c3-c3514f44d00f tempest-VolumesSnapshotsTestJSON-1979336738 None] Create snapshot completed successfully
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Lock "cinder-quobyte-825290da-5845-43bd-b343-ff337e09d250" released by "delete_volume" :: held 0.905s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Created reservations ['597d4f30-4107-4043-85df-2e04f2736439', '2040b249-ad8e-4408-90cd-480e8b18955a', '8102f5ea-3ac7-4296-b147-fd917b6fce9c', '34059c43-138b-460a-8209-a48c07ca840b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:14:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:14:59 devstack sudo[92851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:14:59 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:00 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.255s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Deleted volume successfully.
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b713fee2-26fc-48b1-bbc2-beacec56971f tempest-VolumesTestJSON-137943415 None] Lock "cinder-825290da-5845-43bd-b343-ff337e09d250-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:00 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 1073741824" returned: 0 in 0.540s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:00 devstack sudo[92857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298
Aug 29 13:15:00 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:00 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6514777-17cc-46b3-8b62-1e114c962a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f33b15-d68a-4e45-847a-334d3c68f298', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c6f978-db26-4ed0-b0da-2f484f398bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:00 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume volume-84f33b15-d68a-4e45-847a-334d3c68f298 (84f33b15-d68a-4e45-847a-334d3c68f298): created successfully
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c6f978-db26-4ed0-b0da-2f484f398bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (84a82955-0378-4fd3-9ac6-fdecc519497d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-03a1dc96-fc41-4100-9347-fe9a966df735 tempest-VolumesSnapshotTestJSON-1145731193 None] Created volume successfully.
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Acquiring lock "cinder-c8cc0606-833e-4185-87f7-3dc44c6ab1e9-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-c8cc0606-833e-4185-87f7-3dc44c6ab1e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Acquiring lock "cinder-quobyte-b329bb0e-242c-4f00-8067-dccf24e507e8" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-quobyte-b329bb0e-242c-4f00-8067-dccf24e507e8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Acquiring lock "cinder-quobyte-c8cc0606-833e-4185-87f7-3dc44c6ab1e9" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-quobyte-c8cc0606-833e-4185-87f7-3dc44c6ab1e9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Deleting offline snapshot c8cc0606-833e-4185-87f7-3dc44c6ab1e9 of volume b329bb0e-242c-4f00-8067-dccf24e507e8 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] snapshot_file for this snap is: volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7378742-8ba5-4f9e-8b98-16ade1684855]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:00 devstack sudo[92860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9
Aug 29 13:15:00 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Acquiring lock "cinder-74062ff2-d35c-407e-a0c6-ad60635d4ffe-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Lock "cinder-74062ff2-d35c-407e-a0c6-ad60635d4ffe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Acquiring lock "cinder-quobyte-74062ff2-d35c-407e-a0c6-ad60635d4ffe" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Lock "cinder-quobyte-74062ff2-d35c-407e-a0c6-ad60635d4ffe" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1330b82f-b1b1-47e1-aa18-b031305349f5]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:01 devstack sudo[92862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe
Aug 29 13:15:01 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:01 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9" returned: 0 in 0.474s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b329bb0e-242c-4f00-8067-dccf24e507e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c282bc-b5df-45ec-9a76-726ac2ee16be]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:01 devstack sudo[92868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8
Aug 29 13:15:01 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:01 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe" returned: 0 in 0.464s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:01 devstack sudo[92874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe
Aug 29 13:15:01 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Creating offline snapshot 42705c08-eab1-4954-9502-3a3aa541ee24 of volume 84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f3d799-d6d9-4aa4-a469-fdbad0fd8008]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:01 devstack sudo[92876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298
Aug 29 13:15:01 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:01 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8" returned: 0 in 0.457s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:01 devstack sudo[92885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9
Aug 29 13:15:01 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:01 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-74062ff2-d35c-407e-a0c6-ad60635d4ffe" returned: 0 in 0.322s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Lock "cinder-quobyte-74062ff2-d35c-407e-a0c6-ad60635d4ffe" released by "delete_volume" :: held 0.835s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:01 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Created reservations ['b005536a-b27e-4cd1-8c70-3018b7a32f47', '048e896c-4680-4686-abb5-e7732bb64387', '9272b57b-fd3b-45be-91e8-85e372dcdb1e', 'f70d3887-68e5-4acf-862a-9f05b31a8710'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:02 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298" returned: 0 in 0.459s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:02 devstack sudo[92892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 1G
Aug 29 13:15:02 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:02 devstack sudo[92891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:02 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Acquiring lock "cinder-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Lock "cinder-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Acquiring lock "cinder-quobyte-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Lock "cinder-quobyte-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:02 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9" returned: 0 in 0.545s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c6b728-644e-4108-90a8-ec2d4964fce8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:02 devstack sudo[92901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9
Aug 29 13:15:02 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:02 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.386s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Deleted volume successfully.
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8720bbf9-7f39-4872-bdac-ded1037890cf tempest-VolumesTestJSON-137943415 None] Lock "cinder-74062ff2-d35c-407e-a0c6-ad60635d4ffe-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:02 devstack sudo[92905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849
Aug 29 13:15:02 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:02 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 1G" returned: 0 in 0.559s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f33b15-d68a-4e45-847a-334d3c68f298 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:02 devstack sudo[92910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f33b15-d68a-4e45-847a-334d3c68f298 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24
Aug 29 13:15:02 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:02 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8.c8cc0606-833e-4185-87f7-3dc44c6ab1e9" returned: 0 in 0.337s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-quobyte-c8cc0606-833e-4185-87f7-3dc44c6ab1e9" released by "_delete_snapshot" :: held 1.964s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-quobyte-b329bb0e-242c-4f00-8067-dccf24e507e8" released by "delete_snapshot" :: held 2.000s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.quota [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Created reservations ['8a83070b-9b14-49bf-be09-f9cff1624145', 'b87f6c67-abb4-45ee-96cf-26c5d82b810c', 'c411de47-d4ae-499a-b11b-c9f83df49da5', '0a81e34e-5f53-4a20-9ec6-7f0fe3edcc93'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:02 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849" returned: 0 in 0.512s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Delete snapshot completed successfully.
Aug 29 13:15:02 devstack sudo[92918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849
Aug 29 13:15:02 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-b0c25af9-4b4c-48b4-b216-19ad33470464 req-97eaa1e4-d5bc-4f0c-b823-08c94d61f347 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-c8cc0606-833e-4185-87f7-3dc44c6ab1e9-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:03 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f33b15-d68a-4e45-847a-334d3c68f298 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24" returned: 0 in 0.395s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:03 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 is being set with open permissions: ugo+rw
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Acquiring lock "cinder-b329bb0e-242c-4f00-8067-dccf24e507e8-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:03 devstack sudo[92920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24
Aug 29 13:15:03 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-b329bb0e-242c-4f00-8067-dccf24e507e8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Acquiring lock "cinder-quobyte-b329bb0e-242c-4f00-8067-dccf24e507e8" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:03 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849" returned: 0 in 0.311s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-quobyte-b329bb0e-242c-4f00-8067-dccf24e507e8" acquired by "delete_volume" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Lock "cinder-quobyte-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849" released by "delete_volume" :: held 0.925s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9427030a-d347-4c90-8e51-541c45daf4c7]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Created reservations ['7eec1c9a-6f95-4df8-bad9-8bd53cbbc1be', 'c997331a-3aef-4dda-a920-943fde8acda9', 'a6fba62e-0da7-40d9-be70-6e30225b17e2', 'da9354a0-681e-4206-9154-81822b11fc00'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:03 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24" returned: 0 in 0.385s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:03 devstack sudo[92923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8
Aug 29 13:15:03 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:03 devstack sudo[92926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:03 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:03 devstack sudo[92928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.info
Aug 29 13:15:03 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:03 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.323s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:03 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Deleted volume successfully.
Aug 29 13:15:03 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8" returned: 0 in 0.521s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82e9b10a-aa5c-4d36-bb01-5a86a74bd5a0 tempest-VolumesTestJSON-137943415 None] Lock "cinder-de8d1d5f-0e19-4d3d-8c2b-b31e3c95d849-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:03 devstack sudo[92935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8
Aug 29 13:15:03 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:03 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.info" returned: 0 in 0.360s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:03 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.info is being set with open permissions: ugo+rw
Aug 29 13:15:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:03 devstack sudo[92937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.info
Aug 29 13:15:03 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:04 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b329bb0e-242c-4f00-8067-dccf24e507e8" returned: 0 in 0.276s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-quobyte-b329bb0e-242c-4f00-8067-dccf24e507e8" released by "delete_volume" :: held 0.873s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:04 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.info" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:04 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-609ac6fe-0f02-4bef-b0d0-2f4a53cd7ee4 tempest-VolumesSnapshotTestJSON-1145731193 None] Create snapshot completed successfully
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG cinder.quota [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Created reservations ['9ed87b0a-9559-469b-bab6-65dcf2730cd1', '08fbc2b4-654f-49b6-b4e0-90f92f4da4c5', '84ff9e43-d4db-482f-9837-9051ab8027cb', 'e0e95ee2-ebf8-4136-8e4d-3dd09c13c0d5'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:04 devstack sudo[92941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:04 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:04 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.270s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG cinder.manager [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:04 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Deleted volume successfully.
Aug 29 13:15:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-33bfffc8-15da-4988-904b-e83bf6093a13 req-4d631c64-f91c-4c5c-a1a1-e87a41a94ea4 tempest-VolumesSnapshotsTestJSON-1979336738 None] Lock "cinder-b329bb0e-242c-4f00-8067-dccf24e507e8-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (235a175b-b873-4918-8bab-e7da4abb9755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfee4c7a-62b3-4789-8701-38a746f2af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfee4c7a-62b3-4789-8701-38a746f2af34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-791614791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e95e019b56e45338f1353c896253f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42705c08-eab1-4954-9502-3a3aa541ee24,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:06Z,use_quota=True,user_id='a45cc9d9f1fd49b593cc1964c6cd4b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca14ecc-4ceb-42c4-898b-4e2afb53ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca14ecc-4ceb-42c4-898b-4e2afb53ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66c34fc-3a7a-47c6-9d89-0354648ea481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66c34fc-3a7a-47c6-9d89-0354648ea481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb', 'volume_name': 'volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb', 'volume_size': 1, 'snapshot_id': '42705c08-eab1-4954-9502-3a3aa541ee24'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36962988-7e6f-44ed-8edf-fcbdf1440f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36962988-7e6f-44ed-8edf-fcbdf1440f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619cf125-94da-4a6a-87a7-64c794db51ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:05 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume 9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb', 'volume_size': 1, 'snapshot_id': '42705c08-eab1-4954-9502-3a3aa541ee24'}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-42705c08-eab1-4954-9502-3a3aa541ee24-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" by "_create_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-42705c08-eab1-4954-9502-3a3aa541ee24-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Creating volume 9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb from snapshot 42705c08-eab1-4954-9502-3a3aa541ee24 {{(pid=85771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] snapshot: 42705c08-eab1-4954-9502-3a3aa541ee24, volume: 9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[328796fe-1669-4e08-aecc-dd05c4160667]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:06 devstack sudo[92944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24
Aug 29 13:15:06 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:06 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24" returned: 0 in 0.455s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84f33b15-d68a-4e45-847a-334d3c68f298(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:15:06 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[74157a5e-060d-4aa1-aaaa-f7091d286299]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:06 devstack sudo[92949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298
Aug 29 13:15:06 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:06 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298" returned: 0 in 0.416s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:15:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:15:06 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:15:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:06 devstack sudo[92954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb
Aug 29 13:15:06 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:13 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" returned: 0 in 6.794s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:13 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:15:13 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Converted 1024.00 MB image at 150.69 MB/s
Aug 29 13:15:13 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb is being set with open permissions: ugo+rw
Aug 29 13:15:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:13 devstack sudo[92968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb
Aug 29 13:15:13 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:14 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" returned: 0 in 0.325s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" released by "_copy_volume_from_snapshot" :: held 8.124s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=135,cinder:UPDATE=164,cinder:INSERT=39,cinder:DELETE=15 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=138,cinder:UPDATE=162,cinder:DELETE=13,cinder:INSERT=40 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-42705c08-eab1-4954-9502-3a3aa541ee24-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" released by "_create_volume_from_snapshot" :: held 8.232s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.258s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619cf125-94da-4a6a-87a7-64c794db51ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb', 'volume_size': 1, 'snapshot_id': '42705c08-eab1-4954-9502-3a3aa541ee24'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4a6738-9dbc-4e10-addd-46ef82da21a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:14 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Volume volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb (9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb): created successfully
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4a6738-9dbc-4e10-addd-46ef82da21a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Flow 'volume_create_manager' (235a175b-b873-4918-8bab-e7da4abb9755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:14 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-95a48ea9-3873-4ea4-b9ba-40261e09e685 tempest-VolumesSnapshotTestJSON-1145731193 None] Created volume successfully.
Aug 29 13:15:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:15 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c0695-2d66-43b8-88db-fbcc3ff80a58]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:15 devstack sudo[92971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb
Aug 29 13:15:15 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:15 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" returned: 0 in 0.511s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:15 devstack sudo[92976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb
Aug 29 13:15:15 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-84273425-389c-4e31-b36d-816dd2d73591 tempest-GroupSnapshotsV319Test-673775573 None] Group tempest-GroupSnapshotsV319Test-Group-1642290705: creating
Aug 29 13:15:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-84273425-389c-4e31-b36d-816dd2d73591 tempest-GroupSnapshotsV319Test-673775573 None] Group tempest-GroupSnapshotsV319Test-Group-1642290705: created successfully
Aug 29 13:15:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-84273425-389c-4e31-b36d-816dd2d73591 tempest-GroupSnapshotsV319Test-673775573 None] Create group completed successfully.
Aug 29 13:15:15 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" returned: 0 in 0.351s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb" released by "delete_volume" :: held 0.913s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Created reservations ['e927d1c3-84c2-40ad-9744-16ee3b8d8b62', 'ab59eae2-466e-45dc-8ecb-182ec0f6ddd5', 'd1b9a441-3b47-4140-ba86-a9022bb4f3b8', 'ce97a233-f041-49ea-98f9-b141737657df'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:16 devstack sudo[92979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:16 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-42705c08-eab1-4954-9502-3a3aa541ee24-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-42705c08-eab1-4954-9502-3a3aa541ee24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-84f33b15-d68a-4e45-847a-334d3c68f298" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-84f33b15-d68a-4e45-847a-334d3c68f298" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-42705c08-eab1-4954-9502-3a3aa541ee24" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-42705c08-eab1-4954-9502-3a3aa541ee24" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Deleting offline snapshot 42705c08-eab1-4954-9502-3a3aa541ee24 of volume 84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] snapshot_file for this snap is: volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[927d9832-e530-4e22-b08d-1b7a7e914e56]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:16 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Deleted volume successfully.
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c66f5ad7-4c1f-430f-a4e3-ed34eb13e575 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-9a71fab9-0d05-4cd9-b775-f0dd1ee6c4bb-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:16 devstack sudo[92982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24
Aug 29 13:15:16 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:16 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24" returned: 0 in 0.432s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84f33b15-d68a-4e45-847a-334d3c68f298(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[30868cb0-f9d2-441f-8ccf-16a6dabcc1f1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:17 devstack sudo[92988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298
Aug 29 13:15:17 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Flow 'volume_create_manager' (668f3964-4c0c-471b-8f05-f26c8db99b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc3cedd-3c62-4cf8-b19e-0c571983f7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:17 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298" returned: 0 in 0.712s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc3cedd-3c62-4cf8-b19e-0c571983f7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546774397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef4d3df8-bc83-4341-8ae2-2e39e029e749,host='devstack@QuobyteHD#QuobyteHD',id=705e6094-924a-49eb-9e10-79d68c92213d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09dbacc03494baba8d94785c654aceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:18Z,use_quota=True,user_id='b194afa0999b4f088d0b7e9c44330a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fa4adac-3e97-44f2-8922-1592d7601408),volume_type_id=2fa4adac-3e97-44f2-8922-1592d7601408)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1b9e48-9621-40ba-9118-3af0265ce3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1b9e48-9621-40ba-9118-3af0265ce3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd2bd31-77d1-4697-a048-d12f3d773019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:17 devstack sudo[92993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd2bd31-77d1-4697-a048-d12f3d773019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705e6094-924a-49eb-9e10-79d68c92213d', 'volume_name': 'volume-705e6094-924a-49eb-9e10-79d68c92213d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:17 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2113d8-e0ee-41b7-92ec-d766f6b15f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2113d8-e0ee-41b7-92ec-d766f6b15f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5bee62-3bda-48a9-9164-7c302802d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:17 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Volume 705e6094-924a-49eb-9e10-79d68c92213d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705e6094-924a-49eb-9e10-79d68c92213d', 'volume_size': 1}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ef4d3df8-bc83-4341-8ae2-2e39e029e749,created_at=2026-08-29T11:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546774397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef4d3df8-bc83-4341-8ae2-2e39e029e749,host='devstack@QuobyteHD#QuobyteHD',id=705e6094-924a-49eb-9e10-79d68c92213d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09dbacc03494baba8d94785c654aceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:18Z,use_quota=True,user_id='b194afa0999b4f088d0b7e9c44330a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fa4adac-3e97-44f2-8922-1592d7601408),volume_type_id=2fa4adac-3e97-44f2-8922-1592d7601408)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Creating volume 705e6094-924a-49eb-9e10-79d68c92213d {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:15:17 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:15:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:17 devstack sudo[92995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d 1073741824
Aug 29 13:15:17 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:18 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24" returned: 0 in 0.461s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:18 devstack sudo[93008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24
Aug 29 13:15:18 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:18 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d 1073741824" returned: 0 in 0.522s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:18 devstack sudo[93040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d
Aug 29 13:15:18 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:18 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298.42705c08-eab1-4954-9502-3a3aa541ee24" returned: 0 in 0.412s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-42705c08-eab1-4954-9502-3a3aa541ee24" released by "_delete_snapshot" :: held 2.182s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-84f33b15-d68a-4e45-847a-334d3c68f298" released by "delete_snapshot" :: held 2.233s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:18 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d" returned: 0 in 0.336s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5bee62-3bda-48a9-9164-7c302802d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705e6094-924a-49eb-9e10-79d68c92213d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee813b8d-0739-41e6-ac10-26721c0d2b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Created reservations ['f5bcfdee-b227-4443-8897-54ebffc49db1', 'b60c3744-6b2d-4473-8305-07d4aa1c4f0c', '3efa26a9-fbce-4a34-a18e-a7f16a775186', 'd12642a6-e4d4-4553-92b0-77544bedeb87'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Volume volume-705e6094-924a-49eb-9e10-79d68c92213d (705e6094-924a-49eb-9e10-79d68c92213d): created successfully
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee813b8d-0739-41e6-ac10-26721c0d2b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Flow 'volume_create_manager' (668f3964-4c0c-471b-8f05-f26c8db99b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fab943de-a75e-4d84-b8ac-656738c3b64c tempest-GroupSnapshotsV319Test-673775573 None] Created volume successfully.
Aug 29 13:15:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Delete snapshot completed successfully.
Aug 29 13:15:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f7f1d0c-d44d-4045-845f-c6f87e0bd1a9 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-42705c08-eab1-4954-9502-3a3aa541ee24-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-dd4b8306-eebb-423c-977e-79987f0f0124 tempest-GroupSnapshotsTest-1978509635 None] Group tempest-GroupSnapshotsTest-Group-1990355596: creating
Aug 29 13:15:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-dd4b8306-eebb-423c-977e-79987f0f0124 tempest-GroupSnapshotsTest-1978509635 None] Group tempest-GroupSnapshotsTest-Group-1990355596: created successfully
Aug 29 13:15:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-dd4b8306-eebb-423c-977e-79987f0f0124 tempest-GroupSnapshotsTest-1978509635 None] Create group completed successfully.
Aug 29 13:15:19 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] GroupSnapshot 2c63fdaf-3c5f-4bf2-a6db-6047883cdb1a: creating.
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Group snapshot 2c63fdaf-3c5f-4bf2-a6db-6047883cdb1a: creating. {{(pid=85771) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Creating offline snapshot 2034c668-2e63-462d-801d-d186cff2bf5a of volume 705e6094-924a-49eb-9e10-79d68c92213d {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a2d28f-4a92-4355-b24e-ebd79856b3d8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-84f33b15-d68a-4e45-847a-334d3c68f298-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-84f33b15-d68a-4e45-847a-334d3c68f298-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:19 devstack sudo[93049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d
Aug 29 13:15:19 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-84f33b15-d68a-4e45-847a-334d3c68f298" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-84f33b15-d68a-4e45-847a-334d3c68f298" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b00c08f-5dae-4a2f-9e08-d4e92dc596d2]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:19 devstack sudo[93051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298
Aug 29 13:15:19 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:19 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d" returned: 0 in 0.431s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:19 devstack sudo[93056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a 1G
Aug 29 13:15:19 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:20 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298" returned: 0 in 0.449s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:20 devstack sudo[93066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298
Aug 29 13:15:20 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:20 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a 1G" returned: 0 in 0.570s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-705e6094-924a-49eb-9e10-79d68c92213d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:20 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-84f33b15-d68a-4e45-847a-334d3c68f298" returned: 0 in 0.320s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:20 devstack sudo[93075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-705e6094-924a-49eb-9e10-79d68c92213d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a
Aug 29 13:15:20 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-84f33b15-d68a-4e45-847a-334d3c68f298" released by "delete_volume" :: held 0.864s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Created reservations ['2dab54cf-a745-477e-ab56-d0751c7e90e6', '46883a40-9d53-4964-92e4-6fe4801b2e1d', '6d562587-8586-48f5-8f7b-63530ebdf553', '5c3f02a5-a51e-40fd-b051-62126545a033'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:15:20 devstack sudo[93077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:20 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Flow 'volume_create_manager' (625f4ebe-c737-4761-b1cc-567cc05dec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a595d8e-2631-4568-b4c3-9a37eb639843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a595d8e-2631-4568-b4c3-9a37eb639843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667672651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=940878be-c919-437a-92fc-d38404c868ed,host='devstack@QuobyteHD#QuobyteHD',id=ac2d3abc-20e7-4ccf-a560-c69f2667d353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aef47fa436342348f412271d7de5f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:21Z,use_quota=True,user_id='07b1bc43fd7a47f3bfdd0ccca536246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a90acd-11cc-4c1a-a8c3-f0bf2bb66a16),volume_type_id=76a90acd-11cc-4c1a-a8c3-f0bf2bb66a16)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394804d3-9429-47bb-aea5-a4eeffb24980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394804d3-9429-47bb-aea5-a4eeffb24980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b4f960-801d-438a-b98f-05f263a1352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b4f960-801d-438a-b98f-05f263a1352e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2d3abc-20e7-4ccf-a560-c69f2667d353', 'volume_name': 'volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d12107-e435-42a5-8ed7-343199b3e37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d12107-e435-42a5-8ed7-343199b3e37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d6f8ca-baf5-49be-8aa8-23bd004c2cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:21 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Volume ac2d3abc-20e7-4ccf-a560-c69f2667d353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353', 'volume_size': 1}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-e0862304-0783-477d-8b62-db3c58037c81-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-e0862304-0783-477d-8b62-db3c58037c81-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "cinder-quobyte-e0862304-0783-477d-8b62-db3c58037c81" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-e0862304-0783-477d-8b62-db3c58037c81" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:21 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:21 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-705e6094-924a-49eb-9e10-79d68c92213d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a" returned: 0 in 0.691s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.363s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:21 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5849c3c5-37f9-49f4-bad3-bb0455536b12]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Deleted volume successfully.
Aug 29 13:15:21 devstack sudo[93083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a
Aug 29 13:15:21 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dcbc33d6-00fc-47c0-948f-9f43c0274680 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-84f33b15-d68a-4e45-847a-334d3c68f298-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:21 devstack sudo[93084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81
Aug 29 13:15:21 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:21 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a" returned: 0 in 0.305s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:21 devstack sudo[93092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.info
Aug 29 13:15:21 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:21 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81" returned: 0 in 0.474s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:21 devstack sudo[93102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81
Aug 29 13:15:21 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:21 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.info" returned: 0 in 0.350s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:21 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:15:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:22 devstack sudo[93106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.info
Aug 29 13:15:22 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:22 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e0862304-0783-477d-8b62-db3c58037c81" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-quobyte-e0862304-0783-477d-8b62-db3c58037c81" released by "delete_volume" :: held 0.970s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Created reservations ['2b0d5ca9-c84f-43a2-8bf5-d947039e3928', '452c5717-d349-4d7e-8a26-4f70e34e854d', 'f37fb5be-fa2e-4a97-b8c2-8e6686768702', 'd1b5fac7-03ab-4f3d-bf0e-d0997134ea7e'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:22 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.info" returned: 0 in 0.410s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.880s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=940878be-c919-437a-92fc-d38404c868ed,created_at=2026-08-29T11:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667672651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=940878be-c919-437a-92fc-d38404c868ed,host='devstack@QuobyteHD#QuobyteHD',id=ac2d3abc-20e7-4ccf-a560-c69f2667d353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aef47fa436342348f412271d7de5f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:21Z,use_quota=True,user_id='07b1bc43fd7a47f3bfdd0ccca536246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a90acd-11cc-4c1a-a8c3-f0bf2bb66a16),volume_type_id=76a90acd-11cc-4c1a-a8c3-f0bf2bb66a16)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Creating volume ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:15:22 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:22 devstack sudo[93115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 1073741824
Aug 29 13:15:22 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:22 devstack sudo[93118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-25a2bd23-1e90-4efd-b916-003ad77c8064 tempest-GroupSnapshotsV319Test-673775573 None] group_snapshot 2c63fdaf-3c5f-4bf2-a6db-6047883cdb1a: created successfully
Aug 29 13:15:22 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:22 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.287s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Deleted volume successfully.
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609e3316-38db-4ad7-a9ca-6a2b5245ca24 tempest-VolumesSnapshotTestJSON-1145731193 None] Lock "cinder-e0862304-0783-477d-8b62-db3c58037c81-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:22 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 1073741824" returned: 0 in 0.547s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:22 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353
Aug 29 13:15:22 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] group_snapshot 2c63fdaf-3c5f-4bf2-a6db-6047883cdb1a: deleting
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] group_snapshot 2c63fdaf-3c5f-4bf2-a6db-6047883cdb1a: deleting {{(pid=85771) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Acquiring lock "cinder-quobyte-705e6094-924a-49eb-9e10-79d68c92213d" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:23 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353" returned: 0 in 0.281s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Lock "cinder-quobyte-705e6094-924a-49eb-9e10-79d68c92213d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Acquiring lock "cinder-quobyte-2034c668-2e63-462d-801d-d186cff2bf5a" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d6f8ca-baf5-49be-8aa8-23bd004c2cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81bea81-1ccb-4087-89f1-5ef60a518896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Lock "cinder-quobyte-2034c668-2e63-462d-801d-d186cff2bf5a" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Deleting offline snapshot 2034c668-2e63-462d-801d-d186cff2bf5a of volume 705e6094-924a-49eb-9e10-79d68c92213d {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] snapshot_file for this snap is: volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:15:23 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Volume volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 (ac2d3abc-20e7-4ccf-a560-c69f2667d353): created successfully
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81bea81-1ccb-4087-89f1-5ef60a518896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Flow 'volume_create_manager' (625f4ebe-c737-4761-b1cc-567cc05dec65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9694fa9d-be6a-4d06-a394-12abd20d569e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-58619581-1d7a-4acc-afb2-f9e8e3d3cfb4 tempest-GroupSnapshotsTest-1978509635 None] Created volume successfully.
Aug 29 13:15:23 devstack sudo[93129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a
Aug 29 13:15:23 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] GroupSnapshot e62d7275-ea64-4ca9-bdb9-f005046974d7: creating.
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Group snapshot e62d7275-ea64-4ca9-bdb9-f005046974d7: creating. {{(pid=85771) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:23 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a" returned: 0 in 0.608s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-705e6094-924a-49eb-9e10-79d68c92213d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:15:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Creating offline snapshot 8773aa53-d8bd-4f7e-9620-7098a578abc0 of volume ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:15:24 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6db8e1-c8b3-47fc-b6d9-8121750c25c9]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:24 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72e2639-2037-4233-a897-11b13ccf9fbf]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:24 devstack sudo[93135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d
Aug 29 13:15:24 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:24 devstack sudo[93136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353
Aug 29 13:15:24 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d" returned: 0 in 0.468s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:24 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:24 devstack sudo[93146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a
Aug 29 13:15:24 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:24 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353" returned: 0 in 0.592s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:24 devstack sudo[93157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 1G
Aug 29 13:15:24 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:25 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a" returned: 0 in 0.887s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:25 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a
Aug 29 13:15:25 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:25 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 1G" returned: 0 in 0.969s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:25 devstack sudo[93220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0
Aug 29 13:15:25 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:25 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d.2034c668-2e63-462d-801d-d186cff2bf5a" returned: 0 in 0.475s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Lock "cinder-quobyte-2034c668-2e63-462d-801d-d186cff2bf5a" released by "_delete_snapshot" :: held 2.646s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Lock "cinder-quobyte-705e6094-924a-49eb-9e10-79d68c92213d" released by "delete_snapshot" :: held 2.706s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:26 devstack cinder-volume[85771]: WARNING cinder.quota [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-249077009 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-249077009, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:15:26 devstack cinder-volume[85771]: WARNING cinder.quota [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-249077009 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-249077009, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:15:26 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] Created reservations ['dbd0d30f-f571-4bd5-8f84-2b569a87d0de', '46e4ee66-8f37-41b8-9d2d-9f1a0ff4a04c', '76219843-12fb-4047-9d61-8f189a9b7845', '19427a69-dc11-44b0-8b3b-e1262438855d'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:26 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0" returned: 0 in 0.555s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:26 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:15:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:26 devstack sudo[93233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0
Aug 29 13:15:26 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-17be997d-a037-4932-812e-06f2acd97f3b tempest-GroupSnapshotsV319Test-673775573 None] group_snapshot 2c63fdaf-3c5f-4bf2-a6db-6047883cdb1a: deleted successfully
Aug 29 13:15:26 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0" returned: 0 in 0.356s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:26 devstack sudo[93240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.info
Aug 29 13:15:26 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:27 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.info" returned: 0 in 0.506s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:27 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:27 devstack sudo[93243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.info
Aug 29 13:15:27 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Acquiring lock "cinder-quobyte-705e6094-924a-49eb-9e10-79d68c92213d" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Lock "cinder-quobyte-705e6094-924a-49eb-9e10-79d68c92213d" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bc6ad4-5408-4e5f-a2dd-884e24b91889]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:27 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.info" returned: 0 in 0.372s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.551s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:27 devstack sudo[93245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d
Aug 29 13:15:27 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:27 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3ea9c5a7-0859-4ec3-af6f-fa4db2c8c9d3 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot e62d7275-ea64-4ca9-bdb9-f005046974d7: created successfully
Aug 29 13:15:27 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d" returned: 0 in 0.456s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:27 devstack sudo[93252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d
Aug 29 13:15:27 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:28 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-705e6094-924a-49eb-9e10-79d68c92213d" returned: 0 in 0.325s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Lock "cinder-quobyte-705e6094-924a-49eb-9e10-79d68c92213d" released by "delete_volume" :: held 0.866s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Created reservations ['b387a220-0108-4906-a298-2c9e76b8d1a6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:28 devstack cinder-volume[85771]: WARNING cinder.quota [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-249077009 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-249077009, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Created reservations ['56ad99c6-e7fb-43cd-a8e8-774db52e13d2', '22b8a7b5-1d47-455e-bd1a-1ecb2f0556b1', 'c21eccf5-8d02-4802-a630-b2c8b4ed44d3', '473a8900-68b7-432f-aacc-fe8407af4979'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:28 devstack sudo[93256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:28 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:29 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.672s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:29 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8e20ed09-c8c2-455e-a242-73de622de1b8 tempest-GroupSnapshotsV319Test-673775573 None] Delete group completed successfully.
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-8773aa53-d8bd-4f7e-9620-7098a578abc0-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" by "_create_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-8773aa53-d8bd-4f7e-9620-7098a578abc0-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Creating volume cbcd4e8b-6a96-4ce4-9c1e-996f2509d955 from snapshot 8773aa53-d8bd-4f7e-9620-7098a578abc0 {{(pid=85771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] snapshot: 8773aa53-d8bd-4f7e-9620-7098a578abc0, volume: cbcd4e8b-6a96-4ce4-9c1e-996f2509d955,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8397e4af-5486-4a6c-b2d5-b24c6a93f709]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:30 devstack sudo[93267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0
Aug 29 13:15:30 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:30 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0" returned: 0 in 0.611s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:15:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[543f9f88-64b8-44bf-89f1-069da6943d57]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:30 devstack sudo[93272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353
Aug 29 13:15:30 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:31 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353" returned: 0 in 0.513s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:15:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:15:31 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955 not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:15:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:31 devstack sudo[93278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955
Aug 29 13:15:31 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:38 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" returned: 0 in 7.048s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:38 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:15:38 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Converted 1024.00 MB image at 145.27 MB/s
Aug 29 13:15:38 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955 is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:15:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:38 devstack sudo[93294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955
Aug 29 13:15:38 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:38 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" returned: 0 in 0.322s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" released by "_copy_volume_from_snapshot" :: held 8.626s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-8773aa53-d8bd-4f7e-9620-7098a578abc0-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" released by "_create_volume_from_snapshot" :: held 8.711s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.735s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c535b3af-1a4a-41e7-aa63-f0cb8104ae0b tempest-GroupSnapshotsTest-1978509635 None] Create group from source-snapshot-e62d7275-ea64-4ca9-bdb9-f005046974d7 completed successfully.
Aug 29 13:15:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:39 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee46d39-de87-4683-bac5-a6539bc8f37c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:40 devstack sudo[93304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955
Aug 29 13:15:40 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:40 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" returned: 0 in 0.622s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:40 devstack sudo[93311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955
Aug 29 13:15:40 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:40 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" returned: 0 in 0.370s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-cbcd4e8b-6a96-4ce4-9c1e-996f2509d955" released by "delete_volume" :: held 1.051s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['f1c0cc07-b5b0-44f2-9ce2-7f89a8a6b0a6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:41 devstack cinder-volume[85771]: WARNING cinder.quota [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1459407981 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1459407981, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:15:41 devstack cinder-volume[85771]: WARNING cinder.quota [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1459407981 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1459407981, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['78b50803-395b-4629-a530-c6498b8ef139', 'fe456e35-d402-4458-a3f0-84c2222e9a47', 'a75e3d11-cc26-4428-b6f0-605c631c9c73', '4d79d649-5649-4f77-9e85-952ffdc748d6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:41 devstack sudo[93332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:41 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:41 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.300s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:41 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8eb7dece-be89-4809-8cb8-c567cb6bdb83 tempest-GroupSnapshotsTest-1978509635 None] Delete group completed successfully.
Aug 29 13:15:42 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot e62d7275-ea64-4ca9-bdb9-f005046974d7: deleting
Aug 29 13:15:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot e62d7275-ea64-4ca9-bdb9-f005046974d7: deleting {{(pid=85771) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 29 13:15:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-ac2d3abc-20e7-4ccf-a560-c69f2667d353" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-ac2d3abc-20e7-4ccf-a560-c69f2667d353" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-8773aa53-d8bd-4f7e-9620-7098a578abc0" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-8773aa53-d8bd-4f7e-9620-7098a578abc0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Deleting offline snapshot 8773aa53-d8bd-4f7e-9620-7098a578abc0 of volume ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:15:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] snapshot_file for this snap is: volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:15:42 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d93fb9-bb46-4f2a-8f57-7dc7fdeb2c6b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:42 devstack sudo[93335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0
Aug 29 13:15:42 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:43 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0" returned: 0 in 0.478s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:15:43 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[420b65ee-fff2-4408-b9e6-71e1f6cd8564]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:43 devstack sudo[93341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353
Aug 29 13:15:43 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:43 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353" returned: 0 in 0.553s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:43 devstack sudo[93346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0
Aug 29 13:15:43 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:44 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0" returned: 0 in 0.386s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:44 devstack sudo[93351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0
Aug 29 13:15:44 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:44 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353.8773aa53-d8bd-4f7e-9620-7098a578abc0" returned: 0 in 0.394s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-8773aa53-d8bd-4f7e-9620-7098a578abc0" released by "_delete_snapshot" :: held 1.935s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-ac2d3abc-20e7-4ccf-a560-c69f2667d353" released by "delete_snapshot" :: held 1.965s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:44 devstack cinder-volume[85771]: WARNING cinder.quota [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1459407981 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1459407981, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:15:44 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['95a7db44-193b-4dfe-bfa9-de7175e2cdfa', '29c918d6-eb36-497c-b724-72b59b1638e0', 'd5beb391-1615-422e-82d4-454251bd67c1', 'a38ae7ec-efff-42b2-82cf-a0ec8a13eb7b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:44 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fe3ccf7a-8d86-486e-b456-dfaa31f9f2f6 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot e62d7275-ea64-4ca9-bdb9-f005046974d7: deleted successfully
Aug 29 13:15:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-ac2d3abc-20e7-4ccf-a560-c69f2667d353" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:15:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-ac2d3abc-20e7-4ccf-a560-c69f2667d353" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:15:45 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a265f84-42e9-4b3b-b7e1-7faa7155b144]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:45 devstack sudo[93354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353
Aug 29 13:15:45 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:45 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353" returned: 0 in 0.499s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:45 devstack sudo[93360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353
Aug 29 13:15:45 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:45 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ac2d3abc-20e7-4ccf-a560-c69f2667d353" returned: 0 in 0.277s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-ac2d3abc-20e7-4ccf-a560-c69f2667d353" released by "delete_volume" :: held 0.879s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['e287808b-a03c-4e7c-98d2-31e2fda3f827'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:46 devstack cinder-volume[85771]: WARNING cinder.db.api [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1459407981']
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['e01467b5-dcc8-4998-b9d8-8e7338397fc9', '4916a856-8661-4a6a-9476-ea895f8d322c', 'fcc519c5-8b3e-4a13-88ab-deb8aeeee45e', '91a3225d-58e8-41c0-a791-6064e26f4002'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:46 devstack sudo[93363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:46 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:46 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.335s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:46 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:46 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-391a0480-7bdd-4356-bb60-51b62de37383 tempest-GroupSnapshotsTest-1978509635 None] Delete group completed successfully.
Aug 29 13:15:47 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2b8511f2-7fc6-4f0a-baa5-1e224ce49e40 tempest-GroupSnapshotsTest-1978509635 None] Group tempest-GroupSnapshotsTest-Group-1900298512: creating
Aug 29 13:15:47 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2b8511f2-7fc6-4f0a-baa5-1e224ce49e40 tempest-GroupSnapshotsTest-1978509635 None] Group tempest-GroupSnapshotsTest-Group-1900298512: created successfully
Aug 29 13:15:47 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2b8511f2-7fc6-4f0a-baa5-1e224ce49e40 tempest-GroupSnapshotsTest-1978509635 None] Create group completed successfully.
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Flow 'volume_create_manager' (8ca34c7f-7d77-4d6e-b32a-108a14f29630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9f075c-ccaf-43db-9b67-fc76f47caa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9f075c-ccaf-43db-9b67-fc76f47caa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-758846721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=08d1e0ec-4ff8-4730-847c-07b1fd5eee8d,host='devstack@QuobyteHD#QuobyteHD',id=2dafaf14-1343-44e8-9e73-b90693d6bf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aef47fa436342348f412271d7de5f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:49Z,use_quota=True,user_id='07b1bc43fd7a47f3bfdd0ccca536246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38aa004a-bdf2-4208-9cfd-a18968ee7606),volume_type_id=38aa004a-bdf2-4208-9cfd-a18968ee7606)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0548ee8d-95a8-43e8-9eca-fba590faaef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0548ee8d-95a8-43e8-9eca-fba590faaef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333342ba-62e7-459f-8dad-3bce10638271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333342ba-62e7-459f-8dad-3bce10638271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dafaf14-1343-44e8-9e73-b90693d6bf3c', 'volume_name': 'volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c8446f-e6e2-4f7c-b236-3c9363ba9c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c8446f-e6e2-4f7c-b236-3c9363ba9c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1137de2e-1d6a-4f22-b7e6-78eb084c1b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:49 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Volume 2dafaf14-1343-44e8-9e73-b90693d6bf3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c', 'volume_size': 1}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=08d1e0ec-4ff8-4730-847c-07b1fd5eee8d,created_at=2026-08-29T11:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-758846721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=08d1e0ec-4ff8-4730-847c-07b1fd5eee8d,host='devstack@QuobyteHD#QuobyteHD',id=2dafaf14-1343-44e8-9e73-b90693d6bf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aef47fa436342348f412271d7de5f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:49Z,use_quota=True,user_id='07b1bc43fd7a47f3bfdd0ccca536246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38aa004a-bdf2-4208-9cfd-a18968ee7606),volume_type_id=38aa004a-bdf2-4208-9cfd-a18968ee7606)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Creating volume 2dafaf14-1343-44e8-9e73-b90693d6bf3c {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:15:49 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:49 devstack sudo[93367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c 1073741824
Aug 29 13:15:49 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:49 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c 1073741824" returned: 0 in 0.581s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:49 devstack sudo[93373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c
Aug 29 13:15:49 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:50 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c" returned: 0 in 0.452s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:15:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1137de2e-1d6a-4f22-b7e6-78eb084c1b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bf09e2-ed0e-4e6f-9906-ee4b9355c843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:50 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Volume volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c (2dafaf14-1343-44e8-9e73-b90693d6bf3c): created successfully
Aug 29 13:15:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bf09e2-ed0e-4e6f-9906-ee4b9355c843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Flow 'volume_create_manager' (8ca34c7f-7d77-4d6e-b32a-108a14f29630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:50 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2835e049-2821-481d-9b23-3465e28e88b5 tempest-GroupSnapshotsTest-1978509635 None] Created volume successfully.
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Flow 'volume_create_manager' (cd809fba-558a-4b62-ab0e-6509b6d0653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c9eba0-d09f-4e23-86db-731a5f8f3774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c9eba0-d09f-4e23-86db-731a5f8f3774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1088884779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963b1791-d8ec-45b7-8620-f54dc2979359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b7074c35b4474da619a4403d69bf82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:52Z,use_quota=True,user_id='8cacc8def41248bf9eb238aecf4c68c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80749a17-3798-4818-8fd9-6a909dc47ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80749a17-3798-4818-8fd9-6a909dc47ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3691f7eb-0572-4e36-a828-135cea579b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3691f7eb-0572-4e36-a828-135cea579b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963b1791-d8ec-45b7-8620-f54dc2979359', 'volume_name': 'volume-963b1791-d8ec-45b7-8620-f54dc2979359', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65a363e-1c05-4224-b885-b5fc5c0056d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65a363e-1c05-4224-b885-b5fc5c0056d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b887481-2c53-4734-9ed8-9f364f2071f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Volume 963b1791-d8ec-45b7-8620-f54dc2979359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963b1791-d8ec-45b7-8620-f54dc2979359', 'volume_size': 1}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1088884779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963b1791-d8ec-45b7-8620-f54dc2979359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b7074c35b4474da619a4403d69bf82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:52Z,use_quota=True,user_id='8cacc8def41248bf9eb238aecf4c68c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Creating volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:15:52 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:15:52 devstack sudo[93380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359 1073741824
Aug 29 13:15:52 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Flow 'volume_create_manager' (94ff007b-dc55-4ec3-b949-19bdcf9ebf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0fc569-7fad-4c60-9d23-a7474fdcf6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0fc569-7fad-4c60-9d23-a7474fdcf6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-106429534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=08d1e0ec-4ff8-4730-847c-07b1fd5eee8d,host='devstack@QuobyteHD#QuobyteHD',id=fe40b960-9db4-43d9-90f2-4b96ad2dc97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aef47fa436342348f412271d7de5f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:52Z,use_quota=True,user_id='07b1bc43fd7a47f3bfdd0ccca536246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38aa004a-bdf2-4208-9cfd-a18968ee7606),volume_type_id=38aa004a-bdf2-4208-9cfd-a18968ee7606)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000f61b6-a358-4810-989d-a4530ae48e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000f61b6-a358-4810-989d-a4530ae48e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978064a5-5a4c-4f13-9067-2f4cc8f43dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978064a5-5a4c-4f13-9067-2f4cc8f43dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe40b960-9db4-43d9-90f2-4b96ad2dc97d', 'volume_name': 'volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabaffbb-25a5-4a28-af07-782f69b2a247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabaffbb-25a5-4a28-af07-782f69b2a247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce95b2f-bf20-4e29-8fc3-7d05927e2153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Volume fe40b960-9db4-43d9-90f2-4b96ad2dc97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d', 'volume_size': 1}
Aug 29 13:15:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:53 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359 1073741824" returned: 0 in 0.560s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Flow 'volume_create_manager' (34297966-8dee-431e-8aec-38c31191a369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd71a28a-03f3-47c7-96ab-a12e43fa9222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd71a28a-03f3-47c7-96ab-a12e43fa9222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2008655371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e5a2b1-3e9f-46de-b095-7037b26b83b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc816419567d4d1590150af1018fb35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:53Z,use_quota=True,user_id='3f47d625c69245c3ad390aec9c122e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04f28f8-a59f-4b0f-b1f5-7cd5397dffc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:53 devstack sudo[93387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359
Aug 29 13:15:53 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04f28f8-a59f-4b0f-b1f5-7cd5397dffc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1f7126-6a6d-4c62-88ab-4db58e92af56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1f7126-6a6d-4c62-88ab-4db58e92af56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e5a2b1-3e9f-46de-b095-7037b26b83b7', 'volume_name': 'volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f95da6f-6d70-4aaf-86f6-fe144b7cd561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f95da6f-6d70-4aaf-86f6-fe144b7cd561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604ba6db-6369-4b63-94ca-9960e58434d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Volume 03e5a2b1-3e9f-46de-b095-7037b26b83b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7', 'volume_size': 1}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:53 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359" returned: 0 in 0.257s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=08d1e0ec-4ff8-4730-847c-07b1fd5eee8d,created_at=2026-08-29T11:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-106429534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=08d1e0ec-4ff8-4730-847c-07b1fd5eee8d,host='devstack@QuobyteHD#QuobyteHD',id=fe40b960-9db4-43d9-90f2-4b96ad2dc97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aef47fa436342348f412271d7de5f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:52Z,use_quota=True,user_id='07b1bc43fd7a47f3bfdd0ccca536246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38aa004a-bdf2-4208-9cfd-a18968ee7606),volume_type_id=38aa004a-bdf2-4208-9cfd-a18968ee7606)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Creating volume fe40b960-9db4-43d9-90f2-4b96ad2dc97d {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:15:53 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b887481-2c53-4734-9ed8-9f364f2071f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963b1791-d8ec-45b7-8620-f54dc2979359', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd84f7e-6773-403c-be2f-cef89315c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:53 devstack sudo[93390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d 1073741824
Aug 29 13:15:53 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Volume volume-963b1791-d8ec-45b7-8620-f54dc2979359 (963b1791-d8ec-45b7-8620-f54dc2979359): created successfully
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd84f7e-6773-403c-be2f-cef89315c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Flow 'volume_create_manager' (cd809fba-558a-4b62-ab0e-6509b6d0653d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6a39e9dc-ac0c-4684-8cb5-a83b9c0d29c8 tempest-SnapshotsActionsTest-484692124 None] Created volume successfully.
Aug 29 13:15:53 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d 1073741824" returned: 0 in 0.487s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:54 devstack sudo[93396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d
Aug 29 13:15:54 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:54 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" returned: 0 in 0.270s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2008655371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e5a2b1-3e9f-46de-b095-7037b26b83b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc816419567d4d1590150af1018fb35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:15:53Z,use_quota=True,user_id='3f47d625c69245c3ad390aec9c122e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Creating volume 03e5a2b1-3e9f-46de-b095-7037b26b83b7 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:15:54 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce95b2f-bf20-4e29-8fc3-7d05927e2153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dde0f3-7a40-467d-8750-99c30d80fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:54 devstack sudo[93399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7 1073741824
Aug 29 13:15:54 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:54 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Volume volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d (fe40b960-9db4-43d9-90f2-4b96ad2dc97d): created successfully
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dde0f3-7a40-467d-8750-99c30d80fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Flow 'volume_create_manager' (94ff007b-dc55-4ec3-b949-19bdcf9ebf3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5813be98-3df1-434d-8ec4-9847b50d8a15 tempest-GroupSnapshotsTest-1978509635 None] Created volume successfully.
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:54 devstack sudo[93404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:15:54 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-de9f2eb0-fd1f-44db-8df0-9d845669e8d9 tempest-GroupSnapshotsTest-1978509635 None] Update group completed successfully.
Aug 29 13:15:54 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7 1073741824" returned: 0 in 0.644s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:55 devstack sudo[93408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7
Aug 29 13:15:55 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:55 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.510s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:15:55 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.867s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Creating offline snapshot fb5e2a79-df8a-4907-93fa-d66e2f4ea001 of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604ba6db-6369-4b63-94ca-9960e58434d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cc7ae4-22fb-41ce-930a-1d6cbf568161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef8e82e-4da0-45f6-b651-ed2ade26b4f0]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:55 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Volume volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7 (03e5a2b1-3e9f-46de-b095-7037b26b83b7): created successfully
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cc7ae4-22fb-41ce-930a-1d6cbf568161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Flow 'volume_create_manager' (34297966-8dee-431e-8aec-38c31191a369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:15:55 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d686b0ac-6f01-474b-af57-3851848a3d83 tempest-AttachVolumeShelveTestJSON-852594859 None] Created volume successfully.
Aug 29 13:15:55 devstack sudo[93411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359
Aug 29 13:15:55 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:55 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359" returned: 0 in 0.437s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:55 devstack sudo[93416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 1G
Aug 29 13:15:55 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-cfabd01d-e265-4bb2-bb84-cd674a8d031f tempest-GroupSnapshotsTest-1978509635 None] Update group completed successfully.
Aug 29 13:15:56 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 1G" returned: 0 in 0.541s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:56 devstack sudo[93423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:15:56 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:56 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.428s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:56 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 is being set with open permissions: ugo+rw
Aug 29 13:15:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:56 devstack sudo[93430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:15:56 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:57 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.295s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:57 devstack sudo[93433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.info
Aug 29 13:15:57 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:57 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-40444d70-ad56-4ff3-a0de-00a310d5d057 tempest-GroupSnapshotsTest-1978509635 None] Update group completed successfully.
Aug 29 13:15:57 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.info" returned: 0 in 0.342s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:57 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.info is being set with open permissions: ugo+rw
Aug 29 13:15:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:57 devstack sudo[93436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.info
Aug 29 13:15:57 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:15:57 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root
Aug 29 13:15:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.info" returned: 0 in 0.297s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:15:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:15:57 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c1324a01-b51d-41e4-94c5-ce0d9d4a9f00 tempest-SnapshotsActionsTest-484692124 None] Create snapshot completed successfully
Aug 29 13:15:58 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f3856ae8-6865-42d0-81ab-eb2e8ce1b692 tempest-GroupSnapshotsTest-1978509635 None] Update group completed successfully.
Aug 29 13:15:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:15:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:15:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Creating offline snapshot 7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:15:59 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24627d1-99b7-46f6-b793-dfdb66025bfc]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:15:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:15:59 devstack sudo[93453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:15:59 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:00 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.615s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:00 devstack sudo[93458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 1G
Aug 29 13:16:00 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] GroupSnapshot 1822e130-07b8-46f0-a0b9-7e29e1f3a5cb: creating.
Aug 29 13:16:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Group snapshot 1822e130-07b8-46f0-a0b9-7e29e1f3a5cb: creating. {{(pid=85771) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 29 13:16:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:00 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 1G" returned: 0 in 0.639s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:00 devstack sudo[93464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4
Aug 29 13:16:00 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:01 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4" returned: 0 in 0.337s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:01 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 is being set with open permissions: ugo+rw
Aug 29 13:16:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:01 devstack sudo[93470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4
Aug 29 13:16:01 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:01 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4" returned: 0 in 0.314s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.999s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Creating offline snapshot 213eaa4e-6aa4-4120-8ec5-fbaccce29e83 of volume fe40b960-9db4-43d9-90f2-4b96ad2dc97d {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:16:01 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2cffbd32-f94f-418c-a835-98e96aa253af tempest-SnapshotsActionsTest-484692124 None] Create snapshot completed successfully
Aug 29 13:16:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb833c-e91c-48fd-b72f-caefad28c807]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:01 devstack sudo[93473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d
Aug 29 13:16:01 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:02 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" returned: 0 in 0.476s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:02 devstack sudo[93478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 1G
Aug 29 13:16:02 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:02 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 1G" returned: 0 in 0.470s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:02 devstack sudo[93484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83
Aug 29 13:16:02 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-7863f2d8-d4d5-4075-b33f-1721d1d9c0e4-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-7863f2d8-d4d5-4075-b33f-1721d1d9c0e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-quobyte-7863f2d8-d4d5-4075-b33f-1721d1d9c0e4" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-7863f2d8-d4d5-4075-b33f-1721d1d9c0e4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Deleting offline snapshot 7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:16:02 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] snapshot_file for this snap is: volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83" returned: 0 in 0.423s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:02 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f6d151-25d2-40a4-9d98-2e38eebcb2a5]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:02 devstack sudo[93492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83
Aug 29 13:16:02 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:03 devstack sudo[93493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4
Aug 29 13:16:03 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:03 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83" returned: 0 in 0.417s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:03 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:03 devstack sudo[93501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.info
Aug 29 13:16:03 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4" returned: 0 in 0.474s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34254d3-8186-4e22-ab78-a87712aa1347]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:03 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:03 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:03 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.info" returned: 0 in 0.294s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:03 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:03 devstack sudo[93506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.info
Aug 29 13:16:03 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:03 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.465s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:03 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.info" returned: 0 in 0.294s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:03 devstack sudo[93512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4
Aug 29 13:16:03 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.532s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Creating offline snapshot dd86daa8-285c-48fd-9070-90698ec044c3 of volume 2dafaf14-1343-44e8-9e73-b90693d6bf3c {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae81eea-ba66-4026-9f91-16b193e030bf]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:04 devstack sudo[93514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c
Aug 29 13:16:04 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:04 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4" returned: 0 in 0.572s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:04 devstack sudo[93525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4
Aug 29 13:16:04 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:16:04 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Flow 'volume_create_manager' (991103d3-cf10-4dd7-ac75-11d4e10e51b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6858f70-b893-4354-8fca-6725a98e6106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c" returned: 0 in 0.742s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:04 devstack sudo[93539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 1G
Aug 29 13:16:04 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6858f70-b893-4354-8fca-6725a98e6106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1341383688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec56f20-8ce9-4b03-b368-e602f7a8b1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96498d471adc43408d6fcbc3c02aa3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:04Z,use_quota=True,user_id='f1aad50ed9ae467f9592ce2fb8476a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc4e3668-1a9b-4927-b002-9680049b307c),volume_type_id=dc4e3668-1a9b-4927-b002-9680049b307c)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89639c79-993e-4bb0-b951-187a235d62b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89639c79-993e-4bb0-b951-187a235d62b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63309ed-b624-4545-bd66-df0ce9b3977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63309ed-b624-4545-bd66-df0ce9b3977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec56f20-8ce9-4b03-b368-e602f7a8b1d6', 'volume_name': 'volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99ba830-e6d1-43ac-b9ab-75f4fa1e06f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99ba830-e6d1-43ac-b9ab-75f4fa1e06f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a5a62f-3144-42fb-8d33-9f8bb37350cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:05 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Volume 6ec56f20-8ce9-4b03-b368-e602f7a8b1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6', 'volume_size': 1}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:05 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.7863f2d8-d4d5-4075-b33f-1721d1d9c0e4" returned: 0 in 0.616s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-7863f2d8-d4d5-4075-b33f-1721d1d9c0e4" released by "_delete_snapshot" :: held 2.298s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" released by "delete_snapshot" :: held 2.337s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Created reservations ['3243a039-f54d-4f82-a008-f044a2214238', 'fd3ee073-503b-484a-a299-818484d283b5', 'a050c3c6-81ad-4a84-b580-33330bad403f', 'cf076215-edcf-4a77-995b-d1439a2f2fdf'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Delete snapshot completed successfully.
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7edce084-7eb0-4a43-9048-b3674340bdb8 tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-7863f2d8-d4d5-4075-b33f-1721d1d9c0e4-delete_snapshot" released by "delete_snapshot" :: held 2.551s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Flow 'volume_create_manager' (1a473284-35ec-4e8a-980e-72f35e881dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a1d354-c4d7-432d-9a90-01b982eed401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a1d354-c4d7-432d-9a90-01b982eed401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-364458258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c807ee1c-c5b9-45e5-93f3-9ca2775b584c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96498d471adc43408d6fcbc3c02aa3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:05Z,use_quota=True,user_id='f1aad50ed9ae467f9592ce2fb8476a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e859fe1d-58d3-49f7-9d61-f54c4bd2951c),volume_type_id=e859fe1d-58d3-49f7-9d61-f54c4bd2951c)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eff6f0d-8c16-4388-91d4-2af88b181b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eff6f0d-8c16-4388-91d4-2af88b181b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687dce8a-65fc-42d4-bd82-43e3d121fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687dce8a-65fc-42d4-bd82-43e3d121fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c807ee1c-c5b9-45e5-93f3-9ca2775b584c', 'volume_name': 'volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa9ec96-b0df-4a2b-b9fd-4364284e8f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa9ec96-b0df-4a2b-b9fd-4364284e8f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67365efb-f885-467d-9c6e-69c857aa43e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:05 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Volume c807ee1c-c5b9-45e5-93f3-9ca2775b584c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c', 'volume_size': 1}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:05 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 1G" returned: 0 in 0.725s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:05 devstack sudo[93549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3
Aug 29 13:16:05 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:05 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3" returned: 0 in 0.342s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:05 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:16:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:05 devstack sudo[93554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3
Aug 29 13:16:05 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Flow 'volume_create_manager' (af8af3dd-2f4e-4b77-a7c4-4973b836531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac13b9e2-0c56-470f-b556-d593d3d48771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac13b9e2-0c56-470f-b556-d593d3d48771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2012326191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9314b792-2e64-4387-bfa0-5af0d3100771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96498d471adc43408d6fcbc3c02aa3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:06Z,use_quota=True,user_id='f1aad50ed9ae467f9592ce2fb8476a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ab8b633-67ad-429d-8497-3a985b8117e4),volume_type_id=0ab8b633-67ad-429d-8497-3a985b8117e4)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4e51ca-8fd8-44a8-80f7-825b5906f861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4e51ca-8fd8-44a8-80f7-825b5906f861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258f0e5a-0aab-4e04-ba30-07a04763ab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:16:06 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3" returned: 0 in 0.315s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:06 devstack sudo[93557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.info
Aug 29 13:16:06 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258f0e5a-0aab-4e04-ba30-07a04763ab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9314b792-2e64-4387-bfa0-5af0d3100771', 'volume_name': 'volume-9314b792-2e64-4387-bfa0-5af0d3100771', 'volume_size': 1, 'image_id': '1ba5256a-de11-48d2-87ef-f320b756e0d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ba5256a-de11-48d2-87ef-f320b756e0d8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1887502271', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96498d471adc43408d6fcbc3c02aa3ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ba5256a-de11-48d2-87ef-f320b756e0d8', 'created_at': datetime.datetime(2026, 8, 29, 11, 16, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 16, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ba5256a-de11-48d2-87ef-f320b756e0d8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6209a4860>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:06 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b68b3d-7055-4db5-b963-ed9cf38b7955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b68b3d-7055-4db5-b963-ed9cf38b7955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534d7b8c-52af-49c1-ade2-e3e858ac4598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:06 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Volume 9314b792-2e64-4387-bfa0-5af0d3100771: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9314b792-2e64-4387-bfa0-5af0d3100771', 'volume_size': 1, 'image_id': '1ba5256a-de11-48d2-87ef-f320b756e0d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ba5256a-de11-48d2-87ef-f320b756e0d8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1887502271', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96498d471adc43408d6fcbc3c02aa3ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ba5256a-de11-48d2-87ef-f320b756e0d8', 'created_at': datetime.datetime(2026, 8, 29, 11, 16, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 16, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ba5256a-de11-48d2-87ef-f320b756e0d8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6209a4860>}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Trying to clone 9314b792-2e64-4387-bfa0-5af0d3100771 from image 1ba5256a-de11-48d2-87ef-f320b756e0d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ba5256a-de11-48d2-87ef-f320b756e0d8', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.info" returned: 0 in 0.391s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:06 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:06 devstack sudo[93560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.info
Aug 29 13:16:06 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:06 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.info" returned: 0 in 0.269s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.877s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1341383688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec56f20-8ce9-4b03-b368-e602f7a8b1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96498d471adc43408d6fcbc3c02aa3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:04Z,use_quota=True,user_id='f1aad50ed9ae467f9592ce2fb8476a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc4e3668-1a9b-4927-b002-9680049b307c),volume_type_id=dc4e3668-1a9b-4927-b002-9680049b307c)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Creating volume 6ec56f20-8ce9-4b03-b368-e602f7a8b1d6 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:16:06 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:16:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:06 devstack sudo[93563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6 1073741824
Aug 29 13:16:06 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d514058c-c38a-46ef-b24f-b00b7affb25c tempest-GroupSnapshotsTest-1978509635 None] group_snapshot 1822e130-07b8-46f0-a0b9-7e29e1f3a5cb: created successfully
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b816779b-f96a-479f-9557-086f51a3d4a6 req-844a9a19-cafe-49f3-a597-afdf577357e1 tempest-AttachVolumeShelveTestJSON-852594859 None] No connector for attachment 7bd845e8-9bf5-47b8-8546-906eff710421; skipping storage backend terminate_connection call. {{(pid=85771) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b816779b-f96a-479f-9557-086f51a3d4a6 req-844a9a19-cafe-49f3-a597-afdf577357e1 tempest-AttachVolumeShelveTestJSON-852594859 None] Deleting attachment 7bd845e8-9bf5-47b8-8546-906eff710421. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:16:07 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6 1073741824" returned: 0 in 0.499s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:07 devstack sudo[93569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6
Aug 29 13:16:07 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:07 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6" returned: 0 in 0.289s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.241s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-364458258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c807ee1c-c5b9-45e5-93f3-9ca2775b584c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96498d471adc43408d6fcbc3c02aa3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:05Z,use_quota=True,user_id='f1aad50ed9ae467f9592ce2fb8476a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e859fe1d-58d3-49f7-9d61-f54c4bd2951c),volume_type_id=e859fe1d-58d3-49f7-9d61-f54c4bd2951c)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Creating volume c807ee1c-c5b9-45e5-93f3-9ca2775b584c {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:16:07 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:07 devstack sudo[93573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c 1073741824
Aug 29 13:16:07 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a5a62f-3144-42fb-8d33-9f8bb37350cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c912a184-f277-4daf-972e-dc1e24e77530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:07 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Volume volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6 (6ec56f20-8ce9-4b03-b368-e602f7a8b1d6): created successfully
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c912a184-f277-4daf-972e-dc1e24e77530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Flow 'volume_create_manager' (991103d3-cf10-4dd7-ac75-11d4e10e51b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-75635fbf-312a-41c5-b176-ad674d7774f0 tempest-TestInstancesWithCinderVolumes-1397021885 None] Created volume successfully.
Aug 29 13:16:08 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot 1822e130-07b8-46f0-a0b9-7e29e1f3a5cb: deleting
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot 1822e130-07b8-46f0-a0b9-7e29e1f3a5cb: deleting {{(pid=85771) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-213eaa4e-6aa4-4120-8ec5-fbaccce29e83" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-213eaa4e-6aa4-4120-8ec5-fbaccce29e83" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Deleting offline snapshot 213eaa4e-6aa4-4120-8ec5-fbaccce29e83 of volume fe40b960-9db4-43d9-90f2-4b96ad2dc97d {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] snapshot_file for this snap is: volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[81077e75-232f-4a87-9ca8-5bfa2525c0a3]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:08 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c 1073741824" returned: 0 in 0.658s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:08 devstack sudo[93580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c
Aug 29 13:16:08 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:08 devstack sudo[93579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83
Aug 29 13:16:08 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:08 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c" returned: 0 in 0.354s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.383s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Creating offline snapshot a4f6e4f9-342f-42c3-867f-f2bfb1e20777 of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67365efb-f885-467d-9c6e-69c857aa43e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:08 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f6a352-9503-411d-a072-2a32a8d218a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50b2e51-c078-4ac2-8922-88c15cf98a4e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83" returned: 0 in 0.538s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:08 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Volume volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c (c807ee1c-c5b9-45e5-93f3-9ca2775b584c): created successfully
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f6a352-9503-411d-a072-2a32a8d218a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Flow 'volume_create_manager' (1a473284-35ec-4e8a-980e-72f35e881dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2e367d-86ce-4fac-80a1-1dfd6a2c988c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e91a9ec1-0601-4d1a-94d1-91b3dc93d18c tempest-TestInstancesWithCinderVolumes-1397021885 None] Created volume successfully.
Aug 29 13:16:09 devstack sudo[93589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:09 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:09 devstack sudo[93590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d
Aug 29 13:16:09 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:09 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.521s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:09 devstack sudo[93598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 1G
Aug 29 13:16:09 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:09 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" returned: 0 in 0.659s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:09 devstack sudo[93603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83
Aug 29 13:16:09 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:10 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 1G" returned: 0 in 0.588s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:10 devstack sudo[93612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777
Aug 29 13:16:10 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:10 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83" returned: 0 in 0.506s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:10 devstack sudo[93614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83
Aug 29 13:16:10 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:10 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777" returned: 0 in 0.367s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:10 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 is being set with open permissions: ugo+rw
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:10 devstack sudo[93620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777
Aug 29 13:16:10 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:10 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d.213eaa4e-6aa4-4120-8ec5-fbaccce29e83" returned: 0 in 0.305s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-213eaa4e-6aa4-4120-8ec5-fbaccce29e83" released by "_delete_snapshot" :: held 2.142s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" released by "delete_snapshot" :: held 2.177s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-2dafaf14-1343-44e8-9e73-b90693d6bf3c" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-2dafaf14-1343-44e8-9e73-b90693d6bf3c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-dd86daa8-285c-48fd-9070-90698ec044c3" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-dd86daa8-285c-48fd-9070-90698ec044c3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Deleting offline snapshot dd86daa8-285c-48fd-9070-90698ec044c3 of volume 2dafaf14-1343-44e8-9e73-b90693d6bf3c {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] snapshot_file for this snap is: volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f0a7f0-81ed-4380-a241-5aed1e285caa]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:10 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777" returned: 0 in 0.331s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5ab1ab95-6231-4775-9d9e-1aa869ed211d tempest-SnapshotsActionsTest-484692124 None] Create snapshot completed successfully
Aug 29 13:16:10 devstack sudo[93622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3
Aug 29 13:16:10 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:11 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3" returned: 0 in 0.490s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[de853725-1802-422c-b3cd-2afb0a313151]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:11 devstack sudo[93628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c
Aug 29 13:16:11 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:11 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c" returned: 0 in 0.409s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:11 devstack sudo[93634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD, size 20.69 MB, duration 5.03 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:16:11 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Image download 20.69 MB at 4.11 MB/s
Aug 29 13:16:11 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e15b411-5c6e-45a4-85d6-aca4d220de9f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:11 devstack sudo[93636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD
Aug 29 13:16:11 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-a4f6e4f9-342f-42c3-867f-f2bfb1e20777-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-a4f6e4f9-342f-42c3-867f-f2bfb1e20777-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-quobyte-a4f6e4f9-342f-42c3-867f-f2bfb1e20777" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-a4f6e4f9-342f-42c3-867f-f2bfb1e20777" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Deleting offline snapshot a4f6e4f9-342f-42c3-867f-f2bfb1e20777 of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] snapshot_file for this snap is: volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541961a-60a9-4ad6-92be-695d938bf863]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:12 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3" returned: 0 in 0.446s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:12 devstack sudo[93644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3
Aug 29 13:16:12 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:12 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Temporary image 1ba5256a-de11-48d2-87ef-f320b756e0d8 is fetched for user f1aad50ed9ae467f9592ce2fb8476a67. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:16:12 devstack sudo[93641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777
Aug 29 13:16:12 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb39278-b60c-47ab-8711-64c2e6845ed9]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:12 devstack sudo[93648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD
Aug 29 13:16:12 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:12 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c.dd86daa8-285c-48fd-9070-90698ec044c3" returned: 0 in 0.328s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-dd86daa8-285c-48fd-9070-90698ec044c3" released by "_delete_snapshot" :: held 1.839s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-2dafaf14-1343-44e8-9e73-b90693d6bf3c" released by "delete_snapshot" :: held 1.871s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:12 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777" returned: 0 in 0.547s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cc36d0-5b2a-4e33-b8c1-a87ff024ace1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:12 devstack cinder-volume[85771]: WARNING cinder.quota [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-439054255 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-439054255, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:16:12 devstack cinder-volume[85771]: WARNING cinder.quota [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-439054255 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-439054255, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['504666d7-4650-4068-842f-238739798fbd', 'e23034ee-8a32-4386-93da-e64aa4038c9c', '522b53a2-0588-404b-b2f5-920202e8206a', '775f8ea2-ae0c-40a4-81a6-44dafe1cc378'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:12 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2012326191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9314b792-2e64-4387-bfa0-5af0d3100771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96498d471adc43408d6fcbc3c02aa3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:06Z,use_quota=True,user_id='f1aad50ed9ae467f9592ce2fb8476a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ab8b633-67ad-429d-8497-3a985b8117e4),volume_type_id=0ab8b633-67ad-429d-8497-3a985b8117e4)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Creating volume 9314b792-2e64-4387-bfa0-5af0d3100771 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:16:12 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:12 devstack sudo[93659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 1073741824
Aug 29 13:16:12 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:12 devstack sudo[93654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:12 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:12 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['2b025adb-5e5e-4dd6-9eea-e4a5ec0cc2dd', 'a004dd37-f170-48a5-814a-2ee32b383080', '64c70d47-e676-4354-80f2-a61d6e6a7447', '7c1d148d-60ec-4a9f-abaf-62113ca5eed4'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-87471ba4-a7a0-465b-85b6-9a7defffb673 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot 1822e130-07b8-46f0-a0b9-7e29e1f3a5cb: deleted successfully
Aug 29 13:16:13 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.608s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:13 devstack sudo[93671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777
Aug 29 13:16:13 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:13 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 1073741824" returned: 0 in 0.723s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:13 devstack sudo[93673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771
Aug 29 13:16:13 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-2dafaf14-1343-44e8-9e73-b90693d6bf3c" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-2dafaf14-1343-44e8-9e73-b90693d6bf3c" acquired by "delete_volume" :: waited 0.040s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e05e487-917d-4dee-b152-0840236d2d03]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:13 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:13 devstack sudo[93678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c
Aug 29 13:16:13 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777" returned: 0 in 0.736s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:13 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771" returned: 0 in 0.492s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:13 devstack sudo[93681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777
Aug 29 13:16:13 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:13 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Attempting download of 1ba5256a-de11-48d2-87ef-f320b756e0d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ba5256a-de11-48d2-87ef-f320b756e0d8', 'metadata': {}}])) to volume 9314b792-2e64-4387-bfa0-5af0d3100771. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e11c40f-95c7-48c6-945e-21770d5d56dc]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ba5256a-de11-48d2-87ef-f320b756e0d8_xu_r4m92 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:14 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c" returned: 0 in 0.507s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:14 devstack sudo[93683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ba5256a-de11-48d2-87ef-f320b756e0d8_xu_r4m92
Aug 29 13:16:14 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:14 devstack sudo[93688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c
Aug 29 13:16:14 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:14 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.a4f6e4f9-342f-42c3-867f-f2bfb1e20777" returned: 0 in 0.393s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-a4f6e4f9-342f-42c3-867f-f2bfb1e20777" released by "_delete_snapshot" :: held 2.410s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" released by "delete_snapshot" :: held 2.445s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=149,cinder:INSERT=35,cinder:UPDATE=143,cinder:DELETE=6 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=138,cinder:DELETE=9,cinder:SELECT=141,cinder:INSERT=33 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Created reservations ['03ec1abd-0e02-44a8-b9d7-cf1e76a3d881', '2790691d-8bde-48a0-afbc-8c1c1b26ea7d', '1bf2c1ab-550e-42b7-923b-7ad51f65569b', '76193140-6f49-4b20-9516-6935179b070e'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:14 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ba5256a-de11-48d2-87ef-f320b756e0d8_xu_r4m92" returned: 0 in 0.468s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ba5256a-de11-48d2-87ef-f320b756e0d8_xu_r4m92 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:14 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2dafaf14-1343-44e8-9e73-b90693d6bf3c" returned: 0 in 0.327s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:14 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Delete snapshot completed successfully.
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-2dafaf14-1343-44e8-9e73-b90693d6bf3c" released by "delete_volume" :: held 0.933s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-931bcc30-e48c-4894-965b-872e81e40c8c tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-a4f6e4f9-342f-42c3-867f-f2bfb1e20777-delete_snapshot" released by "delete_snapshot" :: held 2.694s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d8ec31-93ff-42a6-88b7-84477963cd78]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:14 devstack sudo[93694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ba5256a-de11-48d2-87ef-f320b756e0d8_xu_r4m92
Aug 29 13:16:14 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:14 devstack sudo[93695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d
Aug 29 13:16:14 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:14 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ba5256a-de11-48d2-87ef-f320b756e0d8_xu_r4m92" returned: 1 in 0.418s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ba5256a-de11-48d2-87ef-f320b756e0d8_xu_r4m92' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18e5998-9a60-4c08-87c4-39a63b6cc166]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:15 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" returned: 0 in 0.436s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:15 devstack sudo[93710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD
Aug 29 13:16:15 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:15 devstack sudo[93714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d
Aug 29 13:16:15 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:15 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] 1ba5256a-de11-48d2-87ef-f320b756e0d8 was qcow2, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:15 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:15 devstack sudo[93725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771
Aug 29 13:16:15 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-fe40b960-9db4-43d9-90f2-4b96ad2dc97d" released by "delete_volume" :: held 0.863s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Creating offline snapshot 149435ac-7c0b-4044-b56d-0a8dc83fbfe2 of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6048be-f286-48af-9b6d-2931f1df935d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['65bfc08f-dea6-4fbb-8d96-f11069bc8a2f'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:15 devstack cinder-volume[85771]: WARNING cinder.quota [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-439054255 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-439054255, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['67014287-ad01-4e72-8687-10baf0c5c44d', '9c5437b6-d086-424d-a571-6bed0996237a', '80275514-87b5-4bf6-a9cc-5b738a2d01e2', '6eb1fedb-db18-495e-8af2-9c5b0ef0be88'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:15 devstack sudo[93730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:15 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['c11f97bb-31c8-4ffb-916b-7a325553ca38', '0a8e8d04-fdfe-4390-a8e0-2ba9136c82e5', '562f9578-fb72-496d-b9d8-44196e3c6ac1', 'da1a78f7-541c-4404-a0cf-b9aa15ea1b6a'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:15 devstack sudo[93747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:16:15 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:16 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.503s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:16 devstack sudo[93756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 1G
Aug 29 13:16:16 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:16 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.370s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:16 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:16:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1de075f2-8273-46ff-8382-8720cb3b0dd9 tempest-GroupSnapshotsTest-1978509635 None] Delete group completed successfully.
Aug 29 13:16:16 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 1G" returned: 0 in 0.841s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d0f2df2d-f251-49cc-bdf9-2a99d62f8f76 tempest-GroupSnapshotsTest-1978509635 None] Group tempest-GroupSnapshotsTest-Group-1463656393: creating
Aug 29 13:16:16 devstack sudo[93769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2
Aug 29 13:16:16 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d0f2df2d-f251-49cc-bdf9-2a99d62f8f76 tempest-GroupSnapshotsTest-1978509635 None] Group tempest-GroupSnapshotsTest-Group-1463656393: created successfully
Aug 29 13:16:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d0f2df2d-f251-49cc-bdf9-2a99d62f8f76 tempest-GroupSnapshotsTest-1978509635 None] Create group completed successfully.
Aug 29 13:16:17 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2" returned: 0 in 0.323s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:17 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 is being set with open permissions: ugo+rw
Aug 29 13:16:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:17 devstack sudo[93774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2
Aug 29 13:16:17 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:17 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2" returned: 0 in 0.255s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:17 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8fc696a3-4e27-49b6-a080-d56c5cb8ed63 tempest-SnapshotsActionsTest-484692124 None] Create snapshot completed successfully
Aug 29 13:16:17 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771" returned: 0 in 2.390s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:17 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ba5256a-de11-48d2-87ef-f320b756e0d8_g6c9up95devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:16:17 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Converted 112.00 MB image at 46.85 MB/s
Aug 29 13:16:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:17 devstack sudo[93777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 1G
Aug 29 13:16:17 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:18 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 1G" returned: 0 in 0.337s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Downloaded image 1ba5256a-de11-48d2-87ef-f320b756e0d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ba5256a-de11-48d2-87ef-f320b756e0d8', 'metadata': {}}])) to volume 9314b792-2e64-4387-bfa0-5af0d3100771 successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Temporary image 1ba5256a-de11-48d2-87ef-f320b756e0d8 for user f1aad50ed9ae467f9592ce2fb8476a67 is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Marking volume 9314b792-2e64-4387-bfa0-5af0d3100771 as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Copying metadata from image 1ba5256a-de11-48d2-87ef-f320b756e0d8 to 9314b792-2e64-4387-bfa0-5af0d3100771. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Creating volume glance metadata for volume 9314b792-2e64-4387-bfa0-5af0d3100771 backed by image 1ba5256a-de11-48d2-87ef-f320b756e0d8 with: {'image_id': '1ba5256a-de11-48d2-87ef-f320b756e0d8', 'image_name': 'tempest-scenario-img--1887502271', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534d7b8c-52af-49c1-ade2-e3e858ac4598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9314b792-2e64-4387-bfa0-5af0d3100771', 'volume_size': 1, 'image_id': '1ba5256a-de11-48d2-87ef-f320b756e0d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ba5256a-de11-48d2-87ef-f320b756e0d8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1887502271', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96498d471adc43408d6fcbc3c02aa3ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ba5256a-de11-48d2-87ef-f320b756e0d8', 'created_at': datetime.datetime(2026, 8, 29, 11, 16, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 16, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ba5256a-de11-48d2-87ef-f320b756e0d8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6209a4860>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2546c8c-9df4-415b-a97f-2b6c39a8110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Volume volume-9314b792-2e64-4387-bfa0-5af0d3100771 (9314b792-2e64-4387-bfa0-5af0d3100771): created successfully
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2546c8c-9df4-415b-a97f-2b6c39a8110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Flow 'volume_create_manager' (af8af3dd-2f4e-4b77-a7c4-4973b836531d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7291f426-0f1c-4437-bc43-2e7afc1ea242 tempest-TestInstancesWithCinderVolumes-1397021885 None] Created volume successfully.
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Flow 'volume_create_manager' (d33b1a34-1601-470a-8389-ace57bb87585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0239b858-3669-45a2-98b4-8fb23e5bd7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0239b858-3669-45a2-98b4-8fb23e5bd7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-849010482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ea409843-118b-4bd7-bed4-4b84f84359d1,host='devstack@QuobyteHD#QuobyteHD',id=502a6c5a-5b62-4964-b99d-65fe6c5c11a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aef47fa436342348f412271d7de5f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:19Z,use_quota=True,user_id='07b1bc43fd7a47f3bfdd0ccca536246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7b79398-1101-4026-bec0-6175ef2b94a8),volume_type_id=d7b79398-1101-4026-bec0-6175ef2b94a8)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2b50e0-8d80-4711-9d4d-2bc564f73dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2b50e0-8d80-4711-9d4d-2bc564f73dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8258d6-1d72-48cb-b9ef-047981a27adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8258d6-1d72-48cb-b9ef-047981a27adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502a6c5a-5b62-4964-b99d-65fe6c5c11a3', 'volume_name': 'volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e9e9e8-4890-47dd-8b1b-13cf1db7ef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e9e9e8-4890-47dd-8b1b-13cf1db7ef96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fbe231-dc6f-4b84-bec7-0a7e1411be52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Volume 502a6c5a-5b62-4964-b99d-65fe6c5c11a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3', 'volume_size': 1}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ea409843-118b-4bd7-bed4-4b84f84359d1,created_at=2026-08-29T11:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-849010482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ea409843-118b-4bd7-bed4-4b84f84359d1,host='devstack@QuobyteHD#QuobyteHD',id=502a6c5a-5b62-4964-b99d-65fe6c5c11a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aef47fa436342348f412271d7de5f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:19Z,use_quota=True,user_id='07b1bc43fd7a47f3bfdd0ccca536246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7b79398-1101-4026-bec0-6175ef2b94a8),volume_type_id=d7b79398-1101-4026-bec0-6175ef2b94a8)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Creating volume 502a6c5a-5b62-4964-b99d-65fe6c5c11a3 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:16:19 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:19 devstack sudo[93872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 1073741824
Aug 29 13:16:19 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-149435ac-7c0b-4044-b56d-0a8dc83fbfe2-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-149435ac-7c0b-4044-b56d-0a8dc83fbfe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" acquired by "delete_snapshot" :: waited 0.053s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-quobyte-149435ac-7c0b-4044-b56d-0a8dc83fbfe2" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-149435ac-7c0b-4044-b56d-0a8dc83fbfe2" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Deleting offline snapshot 149435ac-7c0b-4044-b56d-0a8dc83fbfe2 of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] snapshot_file for this snap is: volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61bacf9-3f24-4067-8220-19696d27d4a8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:19 devstack sudo[93884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2
Aug 29 13:16:19 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:19 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 1073741824" returned: 0 in 0.992s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:20 devstack sudo[93894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3
Aug 29 13:16:20 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:20 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2" returned: 0 in 0.709s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6e85b3-a174-4efa-8662-f1a36c8eedb4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:20 devstack sudo[93901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:20 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:20 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" returned: 0 in 0.541s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fbe231-dc6f-4b84-bec7-0a7e1411be52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e263bd2-455f-421b-809b-e4b601c2baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:20 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Volume volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 (502a6c5a-5b62-4964-b99d-65fe6c5c11a3): created successfully
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e263bd2-455f-421b-809b-e4b601c2baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Flow 'volume_create_manager' (d33b1a34-1601-470a-8389-ace57bb87585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:20 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e711b569-1114-4e81-a069-b9016c50a924 tempest-GroupSnapshotsTest-1978509635 None] Created volume successfully.
Aug 29 13:16:20 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.603s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:21 devstack sudo[93907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2
Aug 29 13:16:21 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:21 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2" returned: 0 in 0.641s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:21 devstack sudo[93916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2
Aug 29 13:16:21 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] GroupSnapshot ee7c97af-3247-4bd8-858c-33159d4548a1: creating.
Aug 29 13:16:21 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Group snapshot ee7c97af-3247-4bd8-858c-33159d4548a1: creating. {{(pid=85771) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 29 13:16:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.149435ac-7c0b-4044-b56d-0a8dc83fbfe2" returned: 0 in 0.348s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-149435ac-7c0b-4044-b56d-0a8dc83fbfe2" released by "_delete_snapshot" :: held 2.652s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" released by "delete_snapshot" :: held 2.726s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Creating offline snapshot ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 of volume 502a6c5a-5b62-4964-b99d-65fe6c5c11a3 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4dcde9-7327-4a14-8c09-8d0e2817d054]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Created reservations ['f5243cd0-fe30-4132-9632-de41928a55ca', '3d952a35-a125-4b8c-8c66-22da8565872c', 'a390918c-20c0-4595-a59e-6ea532d64809', 'a7c078bf-4f48-491a-abda-cfcde45fd272'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:22 devstack sudo[93920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3
Aug 29 13:16:22 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Delete snapshot completed successfully.
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac97b75c-01b4-460f-a8be-9e9e29c55dcb tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-149435ac-7c0b-4044-b56d-0a8dc83fbfe2-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:22 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" returned: 0 in 0.662s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:22 devstack sudo[93927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 1G
Aug 29 13:16:22 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:23 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 1G" returned: 0 in 0.667s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:23 devstack sudo[93940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07
Aug 29 13:16:23 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-89feb7eb-7dde-4a01-ac42-c54e43be7708 req-02e5253d-5323-4b89-9296-33bd68e53260 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:23 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07" returned: 0 in 0.430s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:23 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:16:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:23 devstack sudo[93945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07
Aug 29 13:16:23 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:24 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07" returned: 0 in 0.342s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:24 devstack sudo[93948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.info
Aug 29 13:16:24 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:24 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.info" returned: 0 in 0.256s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:24 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:24 devstack sudo[93951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.info
Aug 29 13:16:24 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:24 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.info" returned: 0 in 0.287s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.827s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.585s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Creating offline snapshot e3bc63fb-25b8-4be9-a0f7-903dcc8c116e of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[66822915-8633-44fc-9896-3ee516314105]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1d716be4-489c-4e85-88cd-e4e4baf4e201 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot ee7c97af-3247-4bd8-858c-33159d4548a1: created successfully
Aug 29 13:16:25 devstack sudo[93954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:25 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot ee7c97af-3247-4bd8-858c-33159d4548a1: deleting
Aug 29 13:16:25 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.671s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot ee7c97af-3247-4bd8-858c-33159d4548a1: deleting {{(pid=85771) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 29 13:16:25 devstack sudo[93962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e 1G
Aug 29 13:16:25 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" acquired by "delete_snapshot" :: waited 0.043s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Deleting offline snapshot ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 of volume 502a6c5a-5b62-4964-b99d-65fe6c5c11a3 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] snapshot_file for this snap is: volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae91556-765b-43f1-9ab2-756602305e37]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:26 devstack sudo[93964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07
Aug 29 13:16:26 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:26 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e 1G" returned: 0 in 0.662s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:26 devstack sudo[93973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e
Aug 29 13:16:26 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:26 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07" returned: 0 in 0.502s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa28be9-59f6-4fe5-bc82-ead72a872dec]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:26 devstack sudo[93977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3
Aug 29 13:16:26 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:26 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e" returned: 0 in 0.385s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:26 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e is being set with open permissions: ugo+rw
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:26 devstack sudo[93983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e
Aug 29 13:16:26 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:26 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" returned: 0 in 0.491s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:26 devstack sudo[93989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07
Aug 29 13:16:26 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:26 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e" returned: 0 in 0.313s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-89feb7eb-7dde-4a01-ac42-c54e43be7708 req-02e5253d-5323-4b89-9296-33bd68e53260 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.474s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-89feb7eb-7dde-4a01-ac42-c54e43be7708 req-02e5253d-5323-4b89-9296-33bd68e53260 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:27 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5f8591ed-96e2-4938-b493-ae3825833ebb tempest-SnapshotsActionsTest-484692124 None] Create snapshot completed successfully
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-89feb7eb-7dde-4a01-ac42-c54e43be7708 req-02e5253d-5323-4b89-9296-33bd68e53260 tempest-TestInstancesWithCinderVolumes-1397021885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-9314b792-2e64-4387-bfa0-5af0d3100771', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66033bc9-aee7-496e-83f2-f80c55cdf5b7', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:16:27 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-89feb7eb-7dde-4a01-ac42-c54e43be7708 req-02e5253d-5323-4b89-9296-33bd68e53260 tempest-TestInstancesWithCinderVolumes-1397021885 None] attachment_update completed successfully.
Aug 29 13:16:27 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07" returned: 0 in 0.430s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:27 devstack sudo[93995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07
Aug 29 13:16:27 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:27 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3.ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07" returned: 0 in 0.302s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-e3bc63fb-25b8-4be9-a0f7-903dcc8c116e-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-ddb3c2e2-9a8c-4e24-98ce-1c0385abcc07" released by "_delete_snapshot" :: held 1.902s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" released by "delete_snapshot" :: held 1.961s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-e3bc63fb-25b8-4be9-a0f7-903dcc8c116e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Acquiring lock "cinder-quobyte-e3bc63fb-25b8-4be9-a0f7-903dcc8c116e" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-e3bc63fb-25b8-4be9-a0f7-903dcc8c116e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Deleting offline snapshot e3bc63fb-25b8-4be9-a0f7-903dcc8c116e of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] snapshot_file for this snap is: volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f2cd43-7cef-4827-9a43-a40aeab44721]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:27 devstack cinder-volume[85771]: WARNING cinder.quota [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2034672515 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2034672515, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:16:27 devstack cinder-volume[85771]: WARNING cinder.quota [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2034672515 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2034672515, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:16:28 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['06cdcd34-f536-4ae2-8a4e-aee52d4cd5ef', 'e7ecb450-38af-45d0-9bab-725c756080a6', 'fc75c97b-ed78-43ca-8643-c9c127f290fe', '9b31f281-1097-45f4-9a7e-dbe11cd32a17'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:28 devstack sudo[94065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e
Aug 29 13:16:28 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:28 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-aaa4a1bc-baed-41d7-ac2b-74203d9be962 tempest-GroupSnapshotsTest-1978509635 None] group_snapshot ee7c97af-3247-4bd8-858c-33159d4548a1: deleted successfully
Aug 29 13:16:28 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e" returned: 0 in 1.030s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:28 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[19948630-3464-4d8c-b2ca-6a6ddce4e65a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:29 devstack sudo[94431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:29 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:29 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.835s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:29 devstack sudo[94463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e
Aug 29 13:16:29 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "cinder-quobyte-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" acquired by "delete_volume" :: waited 0.035s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[88471a6a-499d-4812-ac27-35420978cd50]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:30 devstack sudo[94465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3
Aug 29 13:16:30 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:30 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e" returned: 0 in 0.848s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:30 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" returned: 0 in 0.578s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:30 devstack sudo[94474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e
Aug 29 13:16:30 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:30 devstack sudo[94478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3
Aug 29 13:16:30 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:31 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.e3bc63fb-25b8-4be9-a0f7-903dcc8c116e" returned: 0 in 0.545s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-e3bc63fb-25b8-4be9-a0f7-903dcc8c116e" released by "_delete_snapshot" :: held 3.427s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" released by "delete_snapshot" :: held 3.480s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:31 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" returned: 0 in 0.733s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Lock "cinder-quobyte-502a6c5a-5b62-4964-b99d-65fe6c5c11a3" released by "delete_volume" :: held 1.454s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Created reservations ['e1388ea6-4e91-4d41-a845-5a3916fda0dc', '116a37f9-7a29-4778-ac59-7663ee1c7ed7', 'cabbd112-d069-43d0-a2ac-cf2fd2845e82', '5fb525c4-c738-4004-9192-e4319a78ce20'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['cd05334e-d03e-4c91-8dab-a06a5d1f17b5'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:31 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Delete snapshot completed successfully.
Aug 29 13:16:31 devstack cinder-volume[85771]: WARNING cinder.quota [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2034672515 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2034672515, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-dc8f4807-5615-451c-9fe9-dc44bceb077d tempest-SnapshotsActionsTest-136614173 None] Lock "cinder-e3bc63fb-25b8-4be9-a0f7-903dcc8c116e-delete_snapshot" released by "delete_snapshot" :: held 3.985s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Created reservations ['8e116a66-15e9-413f-b255-ae6c9e86a360', '45be49ba-4009-499d-a9c6-a16e94c88654', '0cdeec09-ea4d-41d8-a7a1-d17e068ff54d', 'c35a69d7-0b66-4dda-b162-c2ec46a780a6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:32 devstack sudo[94482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:16:32 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:32 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.478s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:32 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:16:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8f9fe4a7-06fe-4a18-81ae-7b4f745ec7f7 tempest-GroupSnapshotsTest-1978509635 None] Delete group completed successfully.
Aug 29 13:16:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "cinder-fb5e2a79-df8a-4907-93fa-d66e2f4ea001-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-fb5e2a79-df8a-4907-93fa-d66e2f4ea001-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" acquired by "delete_snapshot" :: waited 0.064s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "cinder-quobyte-fb5e2a79-df8a-4907-93fa-d66e2f4ea001" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-quobyte-fb5e2a79-df8a-4907-93fa-d66e2f4ea001" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Deleting offline snapshot fb5e2a79-df8a-4907-93fa-d66e2f4ea001 of volume 963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:16:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] snapshot_file for this snap is: volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:16:33 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a644daf6-a31d-4514-8dc9-b8e5f78ac651]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:33 devstack sudo[94486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:33 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:33 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.749s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963b1791-d8ec-45b7-8620-f54dc2979359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:33 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2581641-27ea-4b3a-bdb3-7cd403c9f937]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:34 devstack sudo[94494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359
Aug 29 13:16:34 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:34 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359" returned: 0 in 0.655s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:34 devstack sudo[94499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:34 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:35 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.546s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:35 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001
Aug 29 13:16:35 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:35 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359.fb5e2a79-df8a-4907-93fa-d66e2f4ea001" returned: 0 in 0.398s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-quobyte-fb5e2a79-df8a-4907-93fa-d66e2f4ea001" released by "_delete_snapshot" :: held 2.543s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" released by "delete_snapshot" :: held 2.574s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:35 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Created reservations ['0495f403-1533-4c1c-9cc7-3fbe1ec5308d', '9fba7627-04b5-4750-a293-b529d73b4509', 'a4018207-dbf0-41ea-b182-5e90e2c66210', '1d9b1186-2f4f-48ed-9abe-4d3f96321208'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:35 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Delete snapshot completed successfully.
Aug 29 13:16:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-732e125e-03d5-4b25-8d87-55578fd82a3d tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-fb5e2a79-df8a-4907-93fa-d66e2f4ea001-delete_snapshot" released by "delete_snapshot" :: held 2.857s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "cinder-963b1791-d8ec-45b7-8620-f54dc2979359-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-963b1791-d8ec-45b7-8620-f54dc2979359-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9908d1c1-4372-4430-aba3-5900011b07c0]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:36 devstack sudo[94510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359
Aug 29 13:16:36 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:37 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359" returned: 0 in 0.566s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:37 devstack sudo[94516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359
Aug 29 13:16:37 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:37 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-963b1791-d8ec-45b7-8620-f54dc2979359" returned: 0 in 0.346s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-quobyte-963b1791-d8ec-45b7-8620-f54dc2979359" released by "delete_volume" :: held 1.022s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Created reservations ['8055c4a2-2db4-4da0-ac92-db7f49f69ff9', '5f46661c-1c66-41bd-9e22-e65038c3821b', '97fe9b05-5827-404e-a4ab-80278b02b0e4', 'e3a6b1e8-4885-4411-88e7-3d75834ba2b3'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:37 devstack sudo[94519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:16:37 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:38 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.396s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:38 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:16:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Deleted volume successfully.
Aug 29 13:16:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c54623ea-988b-4002-878a-7ea143ec0af2 tempest-SnapshotsActionsTest-484692124 None] Lock "cinder-963b1791-d8ec-45b7-8620-f54dc2979359-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3c9f0e1f-5247-44d9-a280-2d173f29ea3a tempest-GroupsV314Test-1228107578 None] Group tempest-GroupsV314Test-Group-73153723: creating
Aug 29 13:16:42 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3c9f0e1f-5247-44d9-a280-2d173f29ea3a tempest-GroupsV314Test-1228107578 None] Group tempest-GroupsV314Test-Group-73153723: created successfully
Aug 29 13:16:42 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3c9f0e1f-5247-44d9-a280-2d173f29ea3a tempest-GroupsV314Test-1228107578 None] Create group completed successfully.
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Flow 'volume_create_manager' (a719ae41-34c0-4818-b04e-fdc08895fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a80e1a6-b981-4b50-8a87-970fb0fe10d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a80e1a6-b981-4b50-8a87-970fb0fe10d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495509846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2859414a-f788-4dc7-bf52-72e51e94ff86,host='devstack@QuobyteHD#QuobyteHD',id=f78bfc60-0a3f-4965-b330-ab6b6c1caa0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dd15ed8728438788168a31441f775e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:44Z,use_quota=True,user_id='776cf5dbed134b69968605204ec89d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f407539-71ba-4b64-9408-456dd3dd6a2c),volume_type_id=1f407539-71ba-4b64-9408-456dd3dd6a2c)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0ac701-42d1-4e52-bf1c-eba1b5ea6c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0ac701-42d1-4e52-bf1c-eba1b5ea6c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e912a9-f43d-4ca6-8042-3747a419f56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e912a9-f43d-4ca6-8042-3747a419f56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78bfc60-0a3f-4965-b330-ab6b6c1caa0b', 'volume_name': 'volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9c02c4-e74a-444e-a329-79b08238572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9c02c4-e74a-444e-a329-79b08238572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dda5ae-5b9b-4fd1-bcc2-b26d97a2378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:44 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Volume f78bfc60-0a3f-4965-b330-ab6b6c1caa0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b', 'volume_size': 1}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2859414a-f788-4dc7-bf52-72e51e94ff86,created_at=2026-08-29T11:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495509846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2859414a-f788-4dc7-bf52-72e51e94ff86,host='devstack@QuobyteHD#QuobyteHD',id=f78bfc60-0a3f-4965-b330-ab6b6c1caa0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dd15ed8728438788168a31441f775e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:16:44Z,use_quota=True,user_id='776cf5dbed134b69968605204ec89d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f407539-71ba-4b64-9408-456dd3dd6a2c),volume_type_id=1f407539-71ba-4b64-9408-456dd3dd6a2c)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Creating volume f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:16:44 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:16:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:44 devstack sudo[94556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b 1073741824
Aug 29 13:16:44 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:45 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b 1073741824" returned: 0 in 0.742s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:45 devstack sudo[94564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b
Aug 29 13:16:45 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:45 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b" returned: 0 in 0.326s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:16:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dda5ae-5b9b-4fd1-bcc2-b26d97a2378e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb7667f-3856-4574-a4da-e52237123941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:16:45 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Volume volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b (f78bfc60-0a3f-4965-b330-ab6b6c1caa0b): created successfully
Aug 29 13:16:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb7667f-3856-4574-a4da-e52237123941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:16:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Flow 'volume_create_manager' (a719ae41-34c0-4818-b04e-fdc08895fa63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:16:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-651211b9-ec12-41ac-8d19-2bb3d3541207 tempest-GroupsV314Test-1228107578 None] Created volume successfully.
Aug 29 13:16:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:47 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Cloning volume f78bfc60-0a3f-4965-b330-ab6b6c1caa0b to volume f8553666-bc39-4238-acb0-0dbf8d25ddd3
Aug 29 13:16:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Creating offline snapshot 5d1207cb-ade0-43ce-ae39-2e390e8400b2 of volume f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:16:47 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa89774a-c31e-4ca6-bc3e-5e58212933cc]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:48 devstack sudo[94595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b
Aug 29 13:16:48 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:48 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b" returned: 0 in 0.537s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Acquiring lock "cinder-03e5a2b1-3e9f-46de-b095-7037b26b83b7-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:48 devstack sudo[94603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 1G
Aug 29 13:16:48 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "cinder-03e5a2b1-3e9f-46de-b095-7037b26b83b7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Acquiring lock "cinder-quobyte-03e5a2b1-3e9f-46de-b095-7037b26b83b7" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "cinder-quobyte-03e5a2b1-3e9f-46de-b095-7037b26b83b7" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:48 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbd2d42-3858-4192-8451-900fe18a96eb]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:48 devstack sudo[94605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7
Aug 29 13:16:48 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:49 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7" returned: 0 in 0.481s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:49 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:49 devstack sudo[94614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7
Aug 29 13:16:49 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 1G" returned: 0 in 0.707s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:49 devstack sudo[94616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2
Aug 29 13:16:49 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:49 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:49 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2" returned: 0 in 0.399s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:49 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-03e5a2b1-3e9f-46de-b095-7037b26b83b7" returned: 0 in 0.459s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:49 devstack sudo[94625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2
Aug 29 13:16:49 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "cinder-quobyte-03e5a2b1-3e9f-46de-b095-7037b26b83b7" released by "delete_volume" :: held 1.021s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Created reservations ['2f931e7b-1dea-4bf9-a8a3-19dfc39fccc8', '36aa70c3-15b4-4536-a0cd-3105a6ee107e', '0aa2718f-6fb0-4375-85ec-8a4ca6ceb527', '08755a99-3d9e-4fe7-b007-e4029cde0fd8'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:49 devstack sudo[94627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:16:49 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:49 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2" returned: 0 in 0.322s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:49 devstack sudo[94630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.info
Aug 29 13:16:49 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:50 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:16:50 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Deleted volume successfully.
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7e141659-5e7d-4edd-b769-396f4926f6a3 tempest-AttachVolumeShelveTestJSON-852594859 None] Lock "cinder-03e5a2b1-3e9f-46de-b095-7037b26b83b7-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:50 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.info" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:50 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:50 devstack sudo[94634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.info
Aug 29 13:16:50 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:50 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.info" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Acquiring lock "cinder-quobyte-f8553666-bc39-4238-acb0-0dbf8d25ddd3" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Lock "cinder-quobyte-f8553666-bc39-4238-acb0-0dbf8d25ddd3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] snapshot: 5d1207cb-ade0-43ce-ae39-2e390e8400b2, volume: f8553666-bc39-4238-acb0-0dbf8d25ddd3,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be3f324-5b56-43ff-bc68-40c13f5dc144]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:50 devstack sudo[94637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2
Aug 29 13:16:50 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:50 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2" returned: 0 in 0.414s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5072d4c7-b4eb-4e47-8f3d-6d202ff6d4e1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:51 devstack sudo[94642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b
Aug 29 13:16:51 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:51 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b" returned: 0 in 0.414s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:16:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:16:51 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3 not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:16:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:51 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3
Aug 29 13:16:51 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:16:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:16:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:16:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:16:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:16:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:16:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:54 devstack sudo[94663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:16:54 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:55 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.606s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:16:55 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:16:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:16:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:16:57 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3" returned: 0 in 6.227s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:57 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:16:57 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Converted 1024.00 MB image at 164.43 MB/s
Aug 29 13:16:57 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3 is being set with open permissions: ugo+rw: NotImplementedError
Aug 29 13:16:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:57 devstack sudo[94666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3
Aug 29 13:16:57 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:57 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3" returned: 0 in 0.334s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Lock "cinder-quobyte-f8553666-bc39-4238-acb0-0dbf8d25ddd3" released by "_copy_volume_from_snapshot" :: held 7.465s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:16:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Acquiring lock "cinder-quobyte-5d1207cb-ade0-43ce-ae39-2e390e8400b2" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:16:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Lock "cinder-quobyte-5d1207cb-ade0-43ce-ae39-2e390e8400b2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:16:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Deleting offline snapshot 5d1207cb-ade0-43ce-ae39-2e390e8400b2 of volume f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:16:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] snapshot_file for this snap is: volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:16:58 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36d703c-e42c-47d4-8655-9f301a2d198f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:58 devstack sudo[94669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2
Aug 29 13:16:58 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:58 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2" returned: 0 in 0.556s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:16:58 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dd0765-9b89-40bb-b4a3-62e87bf6f438]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:16:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:58 devstack sudo[94674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b
Aug 29 13:16:58 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:59 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b" returned: 0 in 0.627s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:59 devstack sudo[94680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2
Aug 29 13:16:59 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:16:59 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root
Aug 29 13:16:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2" returned: 0 in 0.523s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:16:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:16:59 devstack sudo[94685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2
Aug 29 13:16:59 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:00 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=96,cinder:INSERT=33,cinder:UPDATE=77,cinder:DELETE=3 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:17:00 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b.5d1207cb-ade0-43ce-ae39-2e390e8400b2" returned: 0 in 0.454s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Lock "cinder-quobyte-5d1207cb-ade0-43ce-ae39-2e390e8400b2" released by "_delete_snapshot" :: held 2.291s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.465s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5cfd7a57-9f3a-4df7-9cec-fd78eaf06b08 tempest-GroupsV314Test-1228107578 None] Create group from source-group-2859414a-f788-4dc7-bf52-72e51e94ff86 completed successfully.
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Acquiring lock "cinder-quobyte-f8553666-bc39-4238-acb0-0dbf8d25ddd3" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Lock "cinder-quobyte-f8553666-bc39-4238-acb0-0dbf8d25ddd3" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[034ea5ff-9e2e-484e-a9a6-61993fdab36f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-102dc7f8-8855-4548-903e-b75d9856401b req-fcee4fdb-9c42-4d39-ba3d-1bda857d4414 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-102dc7f8-8855-4548-903e-b75d9856401b req-fcee4fdb-9c42-4d39-ba3d-1bda857d4414 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-102dc7f8-8855-4548-903e-b75d9856401b req-fcee4fdb-9c42-4d39-ba3d-1bda857d4414 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:02 devstack sudo[94717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3
Aug 29 13:17:02 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-102dc7f8-8855-4548-903e-b75d9856401b req-fcee4fdb-9c42-4d39-ba3d-1bda857d4414 tempest-TestInstancesWithCinderVolumes-1397021885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fa93187-1913-44d0-852f-074165ed227b', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:17:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-102dc7f8-8855-4548-903e-b75d9856401b req-fcee4fdb-9c42-4d39-ba3d-1bda857d4414 tempest-TestInstancesWithCinderVolumes-1397021885 None] attachment_update completed successfully.
Aug 29 13:17:02 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3" returned: 0 in 0.482s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:02 devstack sudo[94725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3
Aug 29 13:17:02 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:03 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f8553666-bc39-4238-acb0-0dbf8d25ddd3" returned: 0 in 0.463s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Lock "cinder-quobyte-f8553666-bc39-4238-acb0-0dbf8d25ddd3" released by "delete_volume" :: held 1.027s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Created reservations ['e5c9e483-1720-481c-92f0-f1fd4683d2a6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:03 devstack cinder-volume[85771]: WARNING cinder.quota [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-175880432 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-175880432, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:03 devstack cinder-volume[85771]: WARNING cinder.quota [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-175880432 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-175880432, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Created reservations ['184bbf7e-b2a0-4df0-8dcc-f3f50d75251e', '9dc15f76-20da-436b-86bb-75d992390b8d', '3228d27d-3a31-4084-ad40-1f420eb14cea', '2fba8171-7ca0-451f-9e59-632d09dbe078'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:03 devstack sudo[94728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:03 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:03 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.296s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:03 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:03 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-44e4d75f-a85e-4b05-a483-acb7b80f1d1f tempest-GroupsV314Test-1228107578 None] Delete group completed successfully.
Aug 29 13:17:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Acquiring lock "cinder-quobyte-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Lock "cinder-quobyte-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a7ab6f-4213-4e71-af87-96995aa7ad36]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:05 devstack sudo[94740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b
Aug 29 13:17:05 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:05 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b" returned: 0 in 0.469s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:05 devstack sudo[94745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b
Aug 29 13:17:05 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:05 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b" returned: 0 in 0.417s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Lock "cinder-quobyte-f78bfc60-0a3f-4965-b330-ab6b6c1caa0b" released by "delete_volume" :: held 0.977s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-111c16e2-2bf7-45fe-aea1-37614390fe05 req-ac448530-4487-48d9-8728-7dd13203c8e3 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-111c16e2-2bf7-45fe-aea1-37614390fe05 req-ac448530-4487-48d9-8728-7dd13203c8e3 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-111c16e2-2bf7-45fe-aea1-37614390fe05 req-ac448530-4487-48d9-8728-7dd13203c8e3 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Created reservations ['180d2e12-5755-464d-8b36-c63253e92227'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-111c16e2-2bf7-45fe-aea1-37614390fe05 req-ac448530-4487-48d9-8728-7dd13203c8e3 tempest-TestInstancesWithCinderVolumes-1397021885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13277f0a-2c2a-49af-8760-ed7b79caab7c', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Created reservations ['0e5e69ea-7986-4589-b5f2-fa1b3ef6d10c', 'a18014bb-5185-4ff6-9c7b-054cbb78d4bb', '9019c356-1f80-4c19-8c69-d802983a0386', 'f1a1944c-a1f7-403f-8948-354d882dd841'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-111c16e2-2bf7-45fe-aea1-37614390fe05 req-ac448530-4487-48d9-8728-7dd13203c8e3 tempest-TestInstancesWithCinderVolumes-1397021885 None] attachment_update completed successfully.
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:06 devstack sudo[94757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:06 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:06 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.493s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:06 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-01b79ec1-4018-401e-b31c-e82133c5e9d5 tempest-GroupsV314Test-1228107578 None] Delete group completed successfully.
Aug 29 13:17:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-5522972a-6b8f-495c-8420-052ffd0acb7e req-d283f1ee-9f5a-4633-8f17-ae855da67908 tempest-TestInstancesWithCinderVolumes-1397021885 None] Terminate volume connection completed successfully.
Aug 29 13:17:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-5522972a-6b8f-495c-8420-052ffd0acb7e req-d283f1ee-9f5a-4633-8f17-ae855da67908 tempest-TestInstancesWithCinderVolumes-1397021885 None] Deleting attachment 6fa93187-1913-44d0-852f-074165ed227b. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:17:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "cinder-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "cinder-quobyte-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-quobyte-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2198f761-097a-44c8-98fc-f2b23fd89b34]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:14 devstack sudo[94799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6
Aug 29 13:17:14 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:14 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6" returned: 0 in 0.597s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:14 devstack sudo[94804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6
Aug 29 13:17:14 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:14 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-quobyte-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6" released by "delete_volume" :: held 1.041s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=118,cinder:INSERT=30,cinder:UPDATE=129,cinder:DELETE=4 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:17:14 devstack cinder-volume[85771]: WARNING cinder.quota [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-68125432-938396838 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-68125432-938396838, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:14 devstack cinder-volume[85771]: WARNING cinder.quota [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-68125432-938396838 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-68125432-938396838, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:14 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Created reservations ['a7246f73-1f0d-4dae-97b4-e16c22a2e849', '4de5f89c-40ba-4f04-a44b-cbdc27deacdc', '3a0032aa-40ee-46f3-9dd5-567f6cd524ef', '85c271e9-acba-4dad-9b5b-d465dd674ebb'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:15 devstack sudo[94807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:15 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:15 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.330s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:15 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Deleted volume successfully.
Aug 29 13:17:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f1069a7e-70dd-4cdd-8cd1-d4d444cba8bf tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-6ec56f20-8ce9-4b03-b368-e602f7a8b1d6-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-22827dcf-3b41-4b6e-900a-5a38eafcfa86 req-d2af06e5-67f4-4600-a94b-723cb9d9c9a7 tempest-TestInstancesWithCinderVolumes-1397021885 None] Terminate volume connection completed successfully.
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-22827dcf-3b41-4b6e-900a-5a38eafcfa86 req-d2af06e5-67f4-4600-a94b-723cb9d9c9a7 tempest-TestInstancesWithCinderVolumes-1397021885 None] Deleting attachment 13277f0a-2c2a-49af-8760-ed7b79caab7c. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Flow 'volume_create_manager' (e13681e2-2db0-4529-a765-9dbff4320c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6471764f-fe3f-4160-8bb6-a6a5bd3d83ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6471764f-fe3f-4160-8bb6-a6a5bd3d83ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2128814544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c62db04-5968-48b9-b83b-f2ade3499aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483d18efb7a3493e882174444c1bab52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:19Z,use_quota=True,user_id='cdcfedae6700412294453f0bc4c9e77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102388b2-1d9c-4448-a47a-37abb3a0fe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102388b2-1d9c-4448-a47a-37abb3a0fe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e250c2-8cdb-4a23-8881-4eb47c7899d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e250c2-8cdb-4a23-8881-4eb47c7899d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c62db04-5968-48b9-b83b-f2ade3499aec', 'volume_name': 'volume-6c62db04-5968-48b9-b83b-f2ade3499aec', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c1f58-a53e-47fe-99eb-2d9f7a42565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c1f58-a53e-47fe-99eb-2d9f7a42565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66a4316-0cef-4a68-9d73-cece34b72974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Volume 6c62db04-5968-48b9-b83b-f2ade3499aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c62db04-5968-48b9-b83b-f2ade3499aec', 'volume_size': 1}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2128814544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c62db04-5968-48b9-b83b-f2ade3499aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483d18efb7a3493e882174444c1bab52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:19Z,use_quota=True,user_id='cdcfedae6700412294453f0bc4c9e77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Creating volume 6c62db04-5968-48b9-b83b-f2ade3499aec {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:17:18 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:17:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:18 devstack sudo[94833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec 1073741824
Aug 29 13:17:18 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "cinder-c807ee1c-c5b9-45e5-93f3-9ca2775b584c-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-c807ee1c-c5b9-45e5-93f3-9ca2775b584c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "cinder-quobyte-c807ee1c-c5b9-45e5-93f3-9ca2775b584c" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-quobyte-c807ee1c-c5b9-45e5-93f3-9ca2775b584c" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb596b85-3a0f-4769-a979-a12d3353e757]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:19 devstack sudo[94840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c
Aug 29 13:17:19 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:19 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec 1073741824" returned: 0 in 0.681s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:19 devstack sudo[94844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec
Aug 29 13:17:19 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:17:19 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Flow 'volume_create_manager' (91b822c4-75b9-4d9d-888b-a44c34e7452f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88beeb8-5471-43d1-bb76-fcb5d1f0a08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c" returned: 0 in 0.621s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88beeb8-5471-43d1-bb76-fcb5d1f0a08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-983758624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9316b174-5020-4270-bbf3-5555541e4067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb851341b2604b0fac8339abacb19bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:20Z,use_quota=True,user_id='4ae590758f1040b7b0bf7b89e9fd6223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:19 devstack sudo[94849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c
Aug 29 13:17:19 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b3a7e7-9d98-4592-8351-5f65d037ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b3a7e7-9d98-4592-8351-5f65d037ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04773ae5-ac32-4294-affc-63227e8b0bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04773ae5-ac32-4294-affc-63227e8b0bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9316b174-5020-4270-bbf3-5555541e4067', 'volume_name': 'volume-9316b174-5020-4270-bbf3-5555541e4067', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4428f0ac-043d-4fcd-84d6-6bcbeed04981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4428f0ac-043d-4fcd-84d6-6bcbeed04981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a0189f-2bb2-4598-a785-6744b26faba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:19 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Volume 9316b174-5020-4270-bbf3-5555541e4067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9316b174-5020-4270-bbf3-5555541e4067', 'volume_size': 1}
Aug 29 13:17:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:20 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec" returned: 0 in 0.396s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-983758624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9316b174-5020-4270-bbf3-5555541e4067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb851341b2604b0fac8339abacb19bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:20Z,use_quota=True,user_id='4ae590758f1040b7b0bf7b89e9fd6223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Creating volume 9316b174-5020-4270-bbf3-5555541e4067 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:17:20 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:20 devstack sudo[94886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067 1073741824
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66a4316-0cef-4a68-9d73-cece34b72974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c62db04-5968-48b9-b83b-f2ade3499aec', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:20 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5b6877-ec75-45d3-9b40-6fc80b73d0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:20 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Volume volume-6c62db04-5968-48b9-b83b-f2ade3499aec (6c62db04-5968-48b9-b83b-f2ade3499aec): created successfully
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5b6877-ec75-45d3-9b40-6fc80b73d0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Flow 'volume_create_manager' (e13681e2-2db0-4529-a765-9dbff4320c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:20 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-432df352-9765-4693-829b-aa8e928781d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Created volume successfully.
Aug 29 13:17:20 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c807ee1c-c5b9-45e5-93f3-9ca2775b584c" returned: 0 in 0.478s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-quobyte-c807ee1c-c5b9-45e5-93f3-9ca2775b584c" released by "delete_volume" :: held 1.190s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:20 devstack cinder-volume[85771]: WARNING cinder.quota [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-328870217-586538129 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-328870217-586538129, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:20 devstack cinder-volume[85771]: WARNING cinder.quota [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-328870217-586538129 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-328870217-586538129, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Created reservations ['acf15290-2069-404a-bf73-82405f6870c6', '9f2d6520-bd8f-4e58-ac58-405c0c77afb4', '55149ab2-089b-4a2b-a22f-88a13b962665', '39176484-068d-49da-aaf3-c91f4378f3aa'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:20 devstack sudo[94894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:20 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:20 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067 1073741824" returned: 0 in 0.753s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:20 devstack sudo[94896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067
Aug 29 13:17:20 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:21 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.342s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Deleted volume successfully.
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7cf5b9b2-2191-4876-b4ca-1e1785a9d09e tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-c807ee1c-c5b9-45e5-93f3-9ca2775b584c-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:21 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067" returned: 0 in 0.356s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a0189f-2bb2-4598-a785-6744b26faba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9316b174-5020-4270-bbf3-5555541e4067', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd6c8e5-007f-4c2f-8d2f-3326ce22c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:21 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Volume volume-9316b174-5020-4270-bbf3-5555541e4067 (9316b174-5020-4270-bbf3-5555541e4067): created successfully
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd6c8e5-007f-4c2f-8d2f-3326ce22c485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Flow 'volume_create_manager' (91b822c4-75b9-4d9d-888b-a44c34e7452f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ee471b28-95cf-48de-b8de-f32c4e9b5731 tempest-VolumeQuotasNegativeTestJSON-129955722 None] Created volume successfully.
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Creating offline snapshot 15008239-0ea4-4f57-9a72-9c24803ef329 of volume 6c62db04-5968-48b9-b83b-f2ade3499aec {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b127a767-bb73-41b5-815d-01224d7d526e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:21 devstack sudo[94901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec
Aug 29 13:17:21 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:21 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec" returned: 0 in 0.544s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:22 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 1G
Aug 29 13:17:22 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:22 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 1G" returned: 0 in 0.588s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c62db04-5968-48b9-b83b-f2ade3499aec -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:22 devstack sudo[94927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c62db04-5968-48b9-b83b-f2ade3499aec -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329
Aug 29 13:17:22 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:23 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c62db04-5968-48b9-b83b-f2ade3499aec -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329" returned: 0 in 0.471s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:23 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 is being set with open permissions: ugo+rw
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:23 devstack sudo[94936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329
Aug 29 13:17:23 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Acquiring lock "cinder-9316b174-5020-4270-bbf3-5555541e4067-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "cinder-9316b174-5020-4270-bbf3-5555541e4067-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:23 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329" returned: 0 in 0.390s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Acquiring lock "cinder-quobyte-9316b174-5020-4270-bbf3-5555541e4067" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "cinder-quobyte-9316b174-5020-4270-bbf3-5555541e4067" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[567841c2-33a4-4c29-a960-c508bd1da4e0]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:23 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.info
Aug 29 13:17:23 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:23 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067
Aug 29 13:17:23 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:23 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.info" returned: 0 in 0.375s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:23 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.info is being set with open permissions: ugo+rw
Aug 29 13:17:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:23 devstack sudo[94946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.info
Aug 29 13:17:23 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:24 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067" returned: 0 in 0.547s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:24 devstack sudo[94951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067
Aug 29 13:17:24 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:24 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.info" returned: 0 in 0.360s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.909s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5b055f95-3c47-4a58-a540-8288f0c6c1e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Create snapshot completed successfully
Aug 29 13:17:24 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9316b174-5020-4270-bbf3-5555541e4067" returned: 0 in 0.579s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "cinder-quobyte-9316b174-5020-4270-bbf3-5555541e4067" released by "delete_volume" :: held 1.188s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:24 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Created reservations ['be22054d-afac-41d0-b3dd-5d49899f50ed', 'd45e8b1c-8122-4539-9689-714842634f01', 'f1b98699-057c-4da7-a352-587b76994ab0', '1c526846-7b03-4b55-a1a5-b58218fc6273'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:25 devstack sudo[94977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:25 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:25 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.282s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Deleted volume successfully.
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e33a3ed-6735-4610-8f36-0de9a39753ea tempest-VolumeQuotasNegativeTestJSON-129955722 None] Lock "cinder-9316b174-5020-4270-bbf3-5555541e4067-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Acquiring lock "cinder-15008239-0ea4-4f57-9a72-9c24803ef329-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-15008239-0ea4-4f57-9a72-9c24803ef329-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Acquiring lock "cinder-quobyte-6c62db04-5968-48b9-b83b-f2ade3499aec" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-quobyte-6c62db04-5968-48b9-b83b-f2ade3499aec" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Acquiring lock "cinder-quobyte-15008239-0ea4-4f57-9a72-9c24803ef329" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-quobyte-15008239-0ea4-4f57-9a72-9c24803ef329" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Deleting offline snapshot 15008239-0ea4-4f57-9a72-9c24803ef329 of volume 6c62db04-5968-48b9-b83b-f2ade3499aec {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] snapshot_file for this snap is: volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11ef0ac-6785-4e21-9df7-b44eeabd40c2]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:25 devstack sudo[94982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329
Aug 29 13:17:25 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:26 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329" returned: 0 in 0.767s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c62db04-5968-48b9-b83b-f2ade3499aec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:17:26 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[583250d8-3c50-4144-9eb6-fb2401334bf6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:26 devstack sudo[95035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec
Aug 29 13:17:26 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:27 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec" returned: 0 in 0.681s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:27 devstack sudo[95055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329
Aug 29 13:17:27 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:27 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-e0c7b92a-e73f-4a09-a42c-5b35fe8bbaf9 req-991bcca5-165c-49f6-91e9-564861bf3da7 tempest-TestInstancesWithCinderVolumes-1397021885 None] Terminate volume connection completed successfully.
Aug 29 13:17:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-e0c7b92a-e73f-4a09-a42c-5b35fe8bbaf9 req-991bcca5-165c-49f6-91e9-564861bf3da7 tempest-TestInstancesWithCinderVolumes-1397021885 None] Deleting attachment 66033bc9-aee7-496e-83f2-f80c55cdf5b7. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:17:27 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329" returned: 0 in 0.619s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:27 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329
Aug 29 13:17:27 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:28 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec.15008239-0ea4-4f57-9a72-9c24803ef329" returned: 0 in 0.463s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-quobyte-15008239-0ea4-4f57-9a72-9c24803ef329" released by "_delete_snapshot" :: held 2.830s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-quobyte-6c62db04-5968-48b9-b83b-f2ade3499aec" released by "delete_snapshot" :: held 2.869s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:28 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Created reservations ['32fd4f6f-71f8-40bb-a311-a722348e7709', 'b3cb2fd0-a8cb-44f6-a07f-f289e8d8cf76', '7e57edec-9039-4fdb-96b4-2cbf8b525561', '33c6eee0-6bb5-4d50-8562-e47d89a8e6f1'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:28 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Delete snapshot completed successfully.
Aug 29 13:17:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d872ef02-d879-4615-bac3-007c5b9df50f tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-15008239-0ea4-4f57-9a72-9c24803ef329-delete_snapshot" released by "delete_snapshot" :: held 3.365s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Acquiring lock "cinder-6c62db04-5968-48b9-b83b-f2ade3499aec-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-6c62db04-5968-48b9-b83b-f2ade3499aec-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Acquiring lock "cinder-quobyte-6c62db04-5968-48b9-b83b-f2ade3499aec" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-quobyte-6c62db04-5968-48b9-b83b-f2ade3499aec" acquired by "delete_volume" :: waited 0.040s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:29 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[811d4177-ef40-448c-830a-2ff2ebb7650b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:29 devstack sudo[95081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec
Aug 29 13:17:29 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:30 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec" returned: 0 in 0.578s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:30 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec
Aug 29 13:17:30 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "cinder-9314b792-2e64-4387-bfa0-5af0d3100771-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-9314b792-2e64-4387-bfa0-5af0d3100771-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "cinder-quobyte-9314b792-2e64-4387-bfa0-5af0d3100771" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-quobyte-9314b792-2e64-4387-bfa0-5af0d3100771" acquired by "delete_volume" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:30 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6c62db04-5968-48b9-b83b-f2ade3499aec" returned: 0 in 0.540s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[65038407-2f11-4de5-8f31-59e0f8f4fa64]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-quobyte-6c62db04-5968-48b9-b83b-f2ade3499aec" released by "delete_volume" :: held 1.272s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Created reservations ['5cbe0a6c-6f21-4002-bfe2-ba5840eb6ea1', '482e2657-d67f-4b3c-9e13-cf34bacb0ec4', 'e9e4a51e-9be7-4602-98e5-b35244d51861', '2474a566-3af6-46c9-a9a1-48b7de7852cf'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:30 devstack sudo[95089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:30 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:31 devstack sudo[95091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:31 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:31 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771" returned: 0 in 0.646s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:31 devstack sudo[95097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771
Aug 29 13:17:31 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:31 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.457s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:31 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:31 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Deleted volume successfully.
Aug 29 13:17:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cc945247-7b16-4c63-89d2-036d2be6afec tempest-VolumeSnapshotQuotasNegativeTestJSON-430021743 None] Lock "cinder-6c62db04-5968-48b9-b83b-f2ade3499aec-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:31 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9314b792-2e64-4387-bfa0-5af0d3100771" returned: 0 in 0.514s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-quobyte-9314b792-2e64-4387-bfa0-5af0d3100771" released by "delete_volume" :: held 1.268s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:31 devstack cinder-volume[85771]: WARNING cinder.quota [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-148839809-701084731 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-148839809-701084731, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:31 devstack cinder-volume[85771]: WARNING cinder.quota [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-148839809-701084731 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-148839809-701084731, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Created reservations ['8f2a17a4-5350-42f8-9f3d-4335aa73c4f1', '617436f3-f6f4-4b53-aa5d-08be6d5153ea', '70ab6fa0-9434-4bb0-97fc-d6291de28b44', '11d5e114-1761-4de1-b428-e0ff36d22580'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:32 devstack sudo[95101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:32 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:32 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.402s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Deleted volume successfully.
Aug 29 13:17:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-97bad771-14c5-44fb-b0f1-cab18eb39691 tempest-TestInstancesWithCinderVolumes-1397021885 None] Lock "cinder-9314b792-2e64-4387-bfa0-5af0d3100771-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Flow 'volume_create_manager' (49d11b55-6a38-4ab0-9627-0cc5810d7f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e681d78-be97-4a3e-9bd2-9ef83c725aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e681d78-be97-4a3e-9bd2-9ef83c725aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-749336079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c26b20-ea0d-49d2-8993-c0d281c29c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec3f0978b9e42819cc94e1b85e303f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:38Z,use_quota=True,user_id='03816aa1c77d44e69b5d0fdd1d0ee8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de809dba-c74c-4cea-8a75-3a3283d985c7),volume_type_id=de809dba-c74c-4cea-8a75-3a3283d985c7)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460ef62f-4a49-468d-b369-d9a001e473e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460ef62f-4a49-468d-b369-d9a001e473e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cb8814-2d4b-46c1-a5ee-b8f5ef6f03af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cb8814-2d4b-46c1-a5ee-b8f5ef6f03af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c26b20-ea0d-49d2-8993-c0d281c29c37', 'volume_name': 'volume-09c26b20-ea0d-49d2-8993-c0d281c29c37', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac29714-2c3b-49e3-84b9-82ea39183910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac29714-2c3b-49e3-84b9-82ea39183910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f1328c-6338-4f29-a35c-1735d4d40493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:37 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Volume 09c26b20-ea0d-49d2-8993-c0d281c29c37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c26b20-ea0d-49d2-8993-c0d281c29c37', 'volume_size': 1}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-749336079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c26b20-ea0d-49d2-8993-c0d281c29c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec3f0978b9e42819cc94e1b85e303f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:38Z,use_quota=True,user_id='03816aa1c77d44e69b5d0fdd1d0ee8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de809dba-c74c-4cea-8a75-3a3283d985c7),volume_type_id=de809dba-c74c-4cea-8a75-3a3283d985c7)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Creating volume 09c26b20-ea0d-49d2-8993-c0d281c29c37 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:17:37 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:17:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:38 devstack sudo[95107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37 1073741824
Aug 29 13:17:38 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:38 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37 1073741824" returned: 0 in 0.498s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:38 devstack sudo[95113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37
Aug 29 13:17:38 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:38 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37" returned: 0 in 0.384s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:17:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f1328c-6338-4f29-a35c-1735d4d40493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c26b20-ea0d-49d2-8993-c0d281c29c37', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08dc2af0-8e1d-4227-9a30-601adcdda183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:39 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Volume volume-09c26b20-ea0d-49d2-8993-c0d281c29c37 (09c26b20-ea0d-49d2-8993-c0d281c29c37): created successfully
Aug 29 13:17:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08dc2af0-8e1d-4227-9a30-601adcdda183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Flow 'volume_create_manager' (49d11b55-6a38-4ab0-9627-0cc5810d7f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:39 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-eb43622e-4262-48e2-a0e3-a9fd1d424a77 tempest-VolumeTypesAccessTest-1504071052 None] Created volume successfully.
Aug 29 13:17:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Acquiring lock "cinder-09c26b20-ea0d-49d2-8993-c0d281c29c37-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Lock "cinder-09c26b20-ea0d-49d2-8993-c0d281c29c37-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Acquiring lock "cinder-quobyte-09c26b20-ea0d-49d2-8993-c0d281c29c37" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Lock "cinder-quobyte-09c26b20-ea0d-49d2-8993-c0d281c29c37" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:40 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[88229bd2-dd73-4280-9dd3-064da68f229c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:40 devstack sudo[95123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37
Aug 29 13:17:40 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:40 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37" returned: 0 in 0.625s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:40 devstack sudo[95152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37
Aug 29 13:17:40 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:41 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-09c26b20-ea0d-49d2-8993-c0d281c29c37" returned: 0 in 0.296s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Lock "cinder-quobyte-09c26b20-ea0d-49d2-8993-c0d281c29c37" released by "delete_volume" :: held 0.984s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:41 devstack cinder-volume[85771]: WARNING cinder.quota [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1166219518 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1166219518, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:41 devstack cinder-volume[85771]: WARNING cinder.quota [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1166219518 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1166219518, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Created reservations ['f2f31879-b329-4778-abd2-70a3c4e6e18f', '58f28531-7973-4c29-8404-ff00420013cd', '7470d19f-5273-4319-8358-d64d4905fcce', 'ddc7b6f5-9e95-4033-8d0f-af4a1deff375'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:41 devstack sudo[95155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:41 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:41 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.317s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Deleted volume successfully.
Aug 29 13:17:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7a18a53c-2750-496c-be72-4d3b78f05be3 tempest-VolumeTypesAccessTest-1504071052 None] Lock "cinder-09c26b20-ea0d-49d2-8993-c0d281c29c37-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Flow 'volume_create_manager' (c82a137a-c9c3-4ff8-84ed-de887c487ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb62e062-c188-40c1-a8f5-6f57d5cf04e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb62e062-c188-40c1-a8f5-6f57d5cf04e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1522572181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83d7b3a-c712-449b-acee-2120f5ec43cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944e336e19144f2d8d849e786bfe1bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:49Z,use_quota=True,user_id='441a44b3b13a469b880b80cb62fa6687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a884686-6836-499f-b42c-6721cb86ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a884686-6836-499f-b42c-6721cb86ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66abf98b-854d-4a42-956c-722ff3661c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66abf98b-854d-4a42-956c-722ff3661c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83d7b3a-c712-449b-acee-2120f5ec43cc', 'volume_name': 'volume-b83d7b3a-c712-449b-acee-2120f5ec43cc', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270373f4-3a35-44f7-bf69-ee09ae2d99c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270373f4-3a35-44f7-bf69-ee09ae2d99c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605bf124-81c6-4cda-ae6b-84b8dbcba6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:49 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Volume b83d7b3a-c712-449b-acee-2120f5ec43cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83d7b3a-c712-449b-acee-2120f5ec43cc', 'volume_size': 1}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1522572181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83d7b3a-c712-449b-acee-2120f5ec43cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944e336e19144f2d8d849e786bfe1bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:49Z,use_quota=True,user_id='441a44b3b13a469b880b80cb62fa6687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Creating volume b83d7b3a-c712-449b-acee-2120f5ec43cc {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:17:49 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:17:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:49 devstack sudo[95163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc 1073741824
Aug 29 13:17:49 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:50 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc 1073741824" returned: 0 in 0.562s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:50 devstack sudo[95168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc
Aug 29 13:17:50 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:50 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc" returned: 0 in 0.279s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:17:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605bf124-81c6-4cda-ae6b-84b8dbcba6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83d7b3a-c712-449b-acee-2120f5ec43cc', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a995d73-2f4f-4e0f-a39b-312edb9bff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:50 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Volume volume-b83d7b3a-c712-449b-acee-2120f5ec43cc (b83d7b3a-c712-449b-acee-2120f5ec43cc): created successfully
Aug 29 13:17:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a995d73-2f4f-4e0f-a39b-312edb9bff99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Flow 'volume_create_manager' (c82a137a-c9c3-4ff8-84ed-de887c487ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:50 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ab08dd8b-ee18-4b30-9472-855be15eb6c2 tempest-AbsoluteLimitsTests-342971035 None] Created volume successfully.
Aug 29 13:17:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Acquiring lock "cinder-b83d7b3a-c712-449b-acee-2120f5ec43cc-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Lock "cinder-b83d7b3a-c712-449b-acee-2120f5ec43cc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Acquiring lock "cinder-quobyte-b83d7b3a-c712-449b-acee-2120f5ec43cc" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:17:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Lock "cinder-quobyte-b83d7b3a-c712-449b-acee-2120f5ec43cc" acquired by "delete_volume" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:17:51 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2130726f-af19-430f-88d5-f02a336d1fa9]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:17:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:51 devstack sudo[95171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc
Aug 29 13:17:51 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:52 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc" returned: 0 in 0.465s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:52 devstack sudo[95183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc
Aug 29 13:17:52 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:52 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b83d7b3a-c712-449b-acee-2120f5ec43cc" returned: 0 in 0.288s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Lock "cinder-quobyte-b83d7b3a-c712-449b-acee-2120f5ec43cc" released by "delete_volume" :: held 0.820s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Created reservations ['ba492902-57a0-4444-871a-bf2735a5c5aa', '665ca098-f260-407b-80d8-fcc4164c976e', 'fa9e7819-4eed-4f18-b0d7-a4976646da1e', '40e2b709-663e-4e7f-9f0c-cdd77165508b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:52 devstack sudo[95187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:52 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:53 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.401s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Deleted volume successfully.
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-11f4991b-0fc7-48b6-bf0e-091eed24a3d7 tempest-AbsoluteLimitsTests-342971035 None] Lock "cinder-b83d7b3a-c712-449b-acee-2120f5ec43cc-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Flow 'volume_create_manager' (e9d61d7f-a492-4971-8b6e-17e4d25efbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0697b95-aa28-4141-8b54-734a2eccf8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0697b95-aa28-4141-8b54-734a2eccf8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-244574591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63906ba1-aa18-41b4-80db-b74afbc5970c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2534b2fd9940f1a22c44166e3635e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:53Z,use_quota=True,user_id='572cccdc39e7472abb30ac2a25ee6e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22328b75-ed48-4420-9b3b-96304cac0dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22328b75-ed48-4420-9b3b-96304cac0dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089a1abb-958b-415d-8695-71ac98700ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089a1abb-958b-415d-8695-71ac98700ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63906ba1-aa18-41b4-80db-b74afbc5970c', 'volume_name': 'volume-63906ba1-aa18-41b4-80db-b74afbc5970c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b0e7d3-523c-442a-a21b-59630937d203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b0e7d3-523c-442a-a21b-59630937d203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b86b3d-3f2c-43ef-8058-1b32bdf177bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Volume 63906ba1-aa18-41b4-80db-b74afbc5970c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63906ba1-aa18-41b4-80db-b74afbc5970c', 'volume_size': 1}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-244574591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63906ba1-aa18-41b4-80db-b74afbc5970c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2534b2fd9940f1a22c44166e3635e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:17:53Z,use_quota=True,user_id='572cccdc39e7472abb30ac2a25ee6e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Creating volume 63906ba1-aa18-41b4-80db-b74afbc5970c {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:17:53 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:17:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:53 devstack sudo[95190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c 1073741824
Aug 29 13:17:53 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:54 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c 1073741824" returned: 0 in 0.536s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:54 devstack sudo[95196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c
Aug 29 13:17:54 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:54 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c" returned: 0 in 0.320s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b86b3d-3f2c-43ef-8058-1b32bdf177bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63906ba1-aa18-41b4-80db-b74afbc5970c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a3a420-1532-4e58-86ff-571b5b18c716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:17:54 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Volume volume-63906ba1-aa18-41b4-80db-b74afbc5970c (63906ba1-aa18-41b4-80db-b74afbc5970c): created successfully
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a3a420-1532-4e58-86ff-571b5b18c716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Flow 'volume_create_manager' (e9d61d7f-a492-4971-8b6e-17e4d25efbb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:17:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3bedf680-ca88-4d54-a016-fdf34df7d58c tempest-AttachVolumeTestJSON-2067344242 None] Created volume successfully.
Aug 29 13:17:54 devstack sudo[95199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:17:54 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:17:54 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.350s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:17:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:17:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-edf4abcb-f37a-4584-8a99-5c9f28e54e96 req-508feac8-5863-4cbd-87e2-e9f4109b4657 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:17:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-edf4abcb-f37a-4584-8a99-5c9f28e54e96 req-508feac8-5863-4cbd-87e2-e9f4109b4657 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:17:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-edf4abcb-f37a-4584-8a99-5c9f28e54e96 req-508feac8-5863-4cbd-87e2-e9f4109b4657 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:17:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-edf4abcb-f37a-4584-8a99-5c9f28e54e96 req-508feac8-5863-4cbd-87e2-e9f4109b4657 tempest-AttachVolumeTestJSON-2067344242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-63906ba1-aa18-41b4-80db-b74afbc5970c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84487fdd-a0fc-4a38-8969-38700cce7da8', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:17:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-edf4abcb-f37a-4584-8a99-5c9f28e54e96 req-508feac8-5863-4cbd-87e2-e9f4109b4657 tempest-AttachVolumeTestJSON-2067344242 None] attachment_update completed successfully.
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Flow 'volume_create_manager' (bfa0005b-32d8-4eee-8e9c-53b43cab2174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dea6c0-a3c9-4e31-a41a-40d7d67c4b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=108,cinder:SELECT=102,cinder:INSERT=20,cinder:DELETE=6 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dea6c0-a3c9-4e31-a41a-40d7d67c4b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-41987988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5329722-bb1b-4458-9de1-84835886f316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b692d55014dd78f8bb8d85980c39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:02Z,use_quota=True,user_id='abcad9f684b04a5c889fcc8636d547c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cb2470-adea-4906-a554-392287cf0c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cb2470-adea-4906-a554-392287cf0c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3413b1f-e099-4228-9bc9-0346d474aa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3413b1f-e099-4228-9bc9-0346d474aa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5329722-bb1b-4458-9de1-84835886f316', 'volume_name': 'volume-d5329722-bb1b-4458-9de1-84835886f316', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b1fb7-9302-4450-89e4-28b3dfef8ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b1fb7-9302-4450-89e4-28b3dfef8ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76abdd67-69b6-40a2-92bb-dca9b6132ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:02 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Volume d5329722-bb1b-4458-9de1-84835886f316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5329722-bb1b-4458-9de1-84835886f316', 'volume_size': 1}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-41987988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5329722-bb1b-4458-9de1-84835886f316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b692d55014dd78f8bb8d85980c39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:02Z,use_quota=True,user_id='abcad9f684b04a5c889fcc8636d547c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Creating volume d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:18:02 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:02 devstack sudo[95600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316 1073741824
Aug 29 13:18:02 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:02 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316 1073741824" returned: 0 in 0.464s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:02 devstack sudo[95607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316
Aug 29 13:18:02 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:03 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316" returned: 0 in 0.300s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:18:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76abdd67-69b6-40a2-92bb-dca9b6132ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5329722-bb1b-4458-9de1-84835886f316', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa91b134-adfb-45f6-a343-3eedd70daa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:03 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Volume volume-d5329722-bb1b-4458-9de1-84835886f316 (d5329722-bb1b-4458-9de1-84835886f316): created successfully
Aug 29 13:18:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa91b134-adfb-45f6-a343-3eedd70daa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Flow 'volume_create_manager' (bfa0005b-32d8-4eee-8e9c-53b43cab2174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:03 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a34c25fc-d7de-4c14-9ea5-3f35dfb5e922 tempest-VolumesDeleteCascade-1143821824 None] Created volume successfully.
Aug 29 13:18:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Creating offline snapshot ebf52209-bca6-48c4-be79-22e6bb4143a1 of volume d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:18:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b3bbb9-8a0a-4773-99ba-6092f7a658ec]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:04 devstack sudo[95610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316
Aug 29 13:18:04 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:04 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316" returned: 0 in 0.438s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:04 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 1G
Aug 29 13:18:04 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:05 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 1G" returned: 0 in 0.492s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5329722-bb1b-4458-9de1-84835886f316 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:05 devstack sudo[95621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5329722-bb1b-4458-9de1-84835886f316 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1
Aug 29 13:18:05 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:05 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5329722-bb1b-4458-9de1-84835886f316 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1" returned: 0 in 0.343s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:05 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 is being set with open permissions: ugo+rw
Aug 29 13:18:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:05 devstack sudo[95627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1
Aug 29 13:18:05 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:06 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1" returned: 0 in 0.282s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:06 devstack sudo[95630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.info
Aug 29 13:18:06 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:06 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.info" returned: 0 in 0.384s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:06 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.info is being set with open permissions: ugo+rw
Aug 29 13:18:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:06 devstack sudo[95633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.info
Aug 29 13:18:06 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:06 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.info" returned: 0 in 0.344s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-696de44a-3bca-4d15-9e02-06ab7ed29fc8 tempest-VolumesDeleteCascade-1143821824 None] Create snapshot completed successfully
Aug 29 13:18:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Creating offline snapshot 59a0ffc3-a367-4d2b-93b9-5aa4ad26369c of volume d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:18:07 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[34129bef-c3db-437d-a643-3bfb40b63703]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:08 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1
Aug 29 13:18:08 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:08 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1" returned: 0 in 0.393s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5329722-bb1b-4458-9de1-84835886f316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:18:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:08 devstack sudo[95641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c 1G
Aug 29 13:18:08 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:08 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c 1G" returned: 0 in 0.610s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:08 devstack sudo[95647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c
Aug 29 13:18:08 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:09 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c" returned: 0 in 0.336s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:09 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c is being set with open permissions: ugo+rw
Aug 29 13:18:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:09 devstack sudo[95653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c
Aug 29 13:18:09 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:09 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.740s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-34bc3b84-6df4-402c-bc01-b36ae8313bed tempest-VolumesDeleteCascade-1143821824 None] Create snapshot completed successfully
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-d5329722-bb1b-4458-9de1-84835886f316-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-d5329722-bb1b-4458-9de1-84835886f316-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Performing cascade delete. {{(pid=85771) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-59a0ffc3-a367-4d2b-93b9-5aa4ad26369c-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-59a0ffc3-a367-4d2b-93b9-5aa4ad26369c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-d5329722-bb1b-4458-9de1-84835886f316" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d5329722-bb1b-4458-9de1-84835886f316" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-59a0ffc3-a367-4d2b-93b9-5aa4ad26369c" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-59a0ffc3-a367-4d2b-93b9-5aa4ad26369c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Deleting offline snapshot 59a0ffc3-a367-4d2b-93b9-5aa4ad26369c of volume d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] snapshot_file for this snap is: volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[895243d2-33d5-4886-9931-9fc4e14bf020]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:10 devstack sudo[95656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c
Aug 29 13:18:10 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:10 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c" returned: 0 in 0.440s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5329722-bb1b-4458-9de1-84835886f316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfb048d-bc4a-4f42-9dba-70311ac70948]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:10 devstack sudo[95662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1
Aug 29 13:18:10 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:11 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1" returned: 0 in 0.669s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5329722-bb1b-4458-9de1-84835886f316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:11 devstack sudo[95667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c
Aug 29 13:18:11 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Flow 'volume_create_manager' (5fd6fd38-575b-45a0-92eb-fc6fb16b325e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4e93a4-04ad-422a-98bd-addf79c79d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4e93a4-04ad-422a-98bd-addf79c79d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-7253114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeea61fc-6983-4819-bba7-12c8d93b34dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be902771402e4c618a3e8298d995b12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:12Z,use_quota=True,user_id='8db094519f104436bfcaebd718f48551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c635185-071a-4e50-9dee-1ed70a132278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c635185-071a-4e50-9dee-1ed70a132278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bb1265-d122-4242-9a9f-c60272953bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bb1265-d122-4242-9a9f-c60272953bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeea61fc-6983-4819-bba7-12c8d93b34dc', 'volume_name': 'volume-eeea61fc-6983-4819-bba7-12c8d93b34dc', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a74881-6214-467d-a78d-7111120c5bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a74881-6214-467d-a78d-7111120c5bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfda486-1539-4128-9504-50102bd5c4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:11 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Volume eeea61fc-6983-4819-bba7-12c8d93b34dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeea61fc-6983-4819-bba7-12c8d93b34dc', 'volume_size': 1}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-7253114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeea61fc-6983-4819-bba7-12c8d93b34dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be902771402e4c618a3e8298d995b12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:12Z,use_quota=True,user_id='8db094519f104436bfcaebd718f48551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Creating volume eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:18:11 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:18:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:12 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c" returned: 0 in 0.637s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:12 devstack sudo[95680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc 1073741824
Aug 29 13:18:12 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:12 devstack sudo[95683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c
Aug 29 13:18:12 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:12 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.59a0ffc3-a367-4d2b-93b9-5aa4ad26369c" returned: 0 in 0.642s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-59a0ffc3-a367-4d2b-93b9-5aa4ad26369c" released by "_delete_snapshot" :: held 2.544s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d5329722-bb1b-4458-9de1-84835886f316" released by "delete_snapshot" :: held 2.592s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:12 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc 1073741824" returned: 0 in 0.887s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:12 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Created reservations ['ed655b5d-e037-46d9-89c6-ee0206611750', '6c0909e6-4b82-4510-89b3-98a26039dfdf', '4268ceb3-7935-437a-853c-c3e9f12c562e', 'f0928750-722f-44da-b649-7bd26dce6fba'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:18:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:12 devstack sudo[95791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc
Aug 29 13:18:12 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Delete snapshot completed successfully.
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-59a0ffc3-a367-4d2b-93b9-5aa4ad26369c-delete_snapshot" released by "delete_snapshot" :: held 2.883s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-ebf52209-bca6-48c4-be79-22e6bb4143a1-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-ebf52209-bca6-48c4-be79-22e6bb4143a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-d5329722-bb1b-4458-9de1-84835886f316" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d5329722-bb1b-4458-9de1-84835886f316" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-ebf52209-bca6-48c4-be79-22e6bb4143a1" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-ebf52209-bca6-48c4-be79-22e6bb4143a1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Deleting offline snapshot ebf52209-bca6-48c4-be79-22e6bb4143a1 of volume d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] snapshot_file for this snap is: volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[146a130f-c8f5-404e-b5da-78fc5a5424c4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:13 devstack sudo[95798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1
Aug 29 13:18:13 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:13 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc" returned: 0 in 0.438s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfda486-1539-4128-9504-50102bd5c4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeea61fc-6983-4819-bba7-12c8d93b34dc', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5cc53a-0edb-4963-85ff-1ffad36c6c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:13 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Volume volume-eeea61fc-6983-4819-bba7-12c8d93b34dc (eeea61fc-6983-4819-bba7-12c8d93b34dc): created successfully
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5cc53a-0edb-4963-85ff-1ffad36c6c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Flow 'volume_create_manager' (5fd6fd38-575b-45a0-92eb-fc6fb16b325e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e66c3333-377b-46a8-9111-1fb95d53d3f9 tempest-VolumesActionsTest-1568861191 None] Created volume successfully.
Aug 29 13:18:13 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1" returned: 0 in 0.537s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5329722-bb1b-4458-9de1-84835886f316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4764e2c7-7001-48fc-bcea-0644beb2f27f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:13 devstack sudo[95812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316
Aug 29 13:18:13 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:14 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316" returned: 0 in 0.720s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:14 devstack sudo[96175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1
Aug 29 13:18:14 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:15 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1" returned: 0 in 0.678s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:15 devstack sudo[96198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1
Aug 29 13:18:15 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:15 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316.ebf52209-bca6-48c4-be79-22e6bb4143a1" returned: 0 in 0.487s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-ebf52209-bca6-48c4-be79-22e6bb4143a1" released by "_delete_snapshot" :: held 2.645s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d5329722-bb1b-4458-9de1-84835886f316" released by "delete_snapshot" :: held 2.686s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:15 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:INSERT=24,cinder:UPDATE=96,cinder:SELECT=72,cinder:DELETE=9 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:18:15 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Created reservations ['cd72135a-c1c9-452b-8e27-11ea6b24607e', 'b6f42c0f-f5be-4e65-babd-50203606e954', 'abbcd2be-26c3-431c-b592-9b6acc69949f', '8ef2633e-ead5-4865-9299-c82cdfa1896a'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:18:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Delete snapshot completed successfully.
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-ebf52209-bca6-48c4-be79-22e6bb4143a1-delete_snapshot" released by "delete_snapshot" :: held 2.983s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Snapshots deleted, issuing volume delete {{(pid=85771) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-d5329722-bb1b-4458-9de1-84835886f316" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d5329722-bb1b-4458-9de1-84835886f316" acquired by "delete_volume" :: waited 0.058s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44be8d3-e7e7-4988-acaa-1a51a2ae8160]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Flow 'volume_create_manager' (c195931a-85a1-4f0d-a4f5-10bf32234687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addc925f-ae2c-42ae-bfd8-3fdbc622df24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addc925f-ae2c-42ae-bfd8-3fdbc622df24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1792149282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6268d7ec-6abd-4b63-ac8e-2395077fd639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0476de1143b997255e7e64a35e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:16Z,use_quota=True,user_id='9e812e99fe53454fb030f1162bd89e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca67a38-901d-4441-9780-376ea68e3531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca67a38-901d-4441-9780-376ea68e3531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc87f27-56b3-4b46-a75e-a7babd01bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc87f27-56b3-4b46-a75e-a7babd01bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6268d7ec-6abd-4b63-ac8e-2395077fd639', 'volume_name': 'volume-6268d7ec-6abd-4b63-ac8e-2395077fd639', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b303b034-f521-4e37-b354-f1c3c428c2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b303b034-f521-4e37-b354-f1c3c428c2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42e332d-bd09-4f80-a326-43efe7856851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:16 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Volume 6268d7ec-6abd-4b63-ac8e-2395077fd639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6268d7ec-6abd-4b63-ac8e-2395077fd639', 'volume_size': 1}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1792149282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6268d7ec-6abd-4b63-ac8e-2395077fd639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0476de1143b997255e7e64a35e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:16Z,use_quota=True,user_id='9e812e99fe53454fb030f1162bd89e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Creating volume 6268d7ec-6abd-4b63-ac8e-2395077fd639 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:18:16 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:18:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:16 devstack sudo[96206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316
Aug 29 13:18:16 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:16 devstack sudo[96207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639 1073741824
Aug 29 13:18:16 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:17 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316" returned: 0 in 0.838s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:17 devstack sudo[96217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316
Aug 29 13:18:17 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Flow 'volume_create_manager' (1271b04f-7ce6-42ba-91ef-1de61396be22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6b0bb9-0a8f-4c3b-8b4d-4d156a4682d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6b0bb9-0a8f-4c3b-8b4d-4d156a4682d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-611018830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d9d43b-e56f-4401-b529-afe84e9f07d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0476de1143b997255e7e64a35e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:17Z,use_quota=True,user_id='9e812e99fe53454fb030f1162bd89e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88be545-34d5-4592-a615-41d40927be2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88be545-34d5-4592-a615-41d40927be2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457aa450-c14c-4fe8-8ed2-04bddd390ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457aa450-c14c-4fe8-8ed2-04bddd390ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d9d43b-e56f-4401-b529-afe84e9f07d2', 'volume_name': 'volume-64d9d43b-e56f-4401-b529-afe84e9f07d2', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d31ca16-a71f-44d3-a479-c3e77b36eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d31ca16-a71f-44d3-a479-c3e77b36eba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:17 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b18fee-c666-4890-824b-1cc52663ee0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:17 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Volume 64d9d43b-e56f-4401-b529-afe84e9f07d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d9d43b-e56f-4401-b529-afe84e9f07d2', 'volume_size': 1}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d5329722-bb1b-4458-9de1-84835886f316" returned: 0 in 0.538s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d5329722-bb1b-4458-9de1-84835886f316" released by "delete_volume" :: held 1.519s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:17 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639 1073741824" returned: 0 in 1.261s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:17 devstack sudo[96224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639
Aug 29 13:18:17 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:17 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Created reservations ['b41cf2ec-3adb-4f2a-94f8-b45cfec3f6a5', 'a11b1a0d-9ebb-4934-8dfe-84275ef39afe', '42c2d716-3f32-454e-8d6f-e451dc660e41', 'd830ff2e-1299-44cd-84a9-0877034df5af'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:18 devstack sudo[96226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:18:18 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:18 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639" returned: 0 in 0.635s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-611018830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d9d43b-e56f-4401-b529-afe84e9f07d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0476de1143b997255e7e64a35e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:17Z,use_quota=True,user_id='9e812e99fe53454fb030f1162bd89e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Creating volume 64d9d43b-e56f-4401-b529-afe84e9f07d2 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:18:18 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:18 devstack sudo[96229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2 1073741824
Aug 29 13:18:18 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42e332d-bd09-4f80-a326-43efe7856851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6268d7ec-6abd-4b63-ac8e-2395077fd639', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:18 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea2b34c-09d2-4ee1-993e-714f817bbb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.435s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:18:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Deleted volume successfully.
Aug 29 13:18:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Volume volume-6268d7ec-6abd-4b63-ac8e-2395077fd639 (6268d7ec-6abd-4b63-ac8e-2395077fd639): created successfully
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea2b34c-09d2-4ee1-993e-714f817bbb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Flow 'volume_create_manager' (c195931a-85a1-4f0d-a4f5-10bf32234687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ea2cc617-9376-4a3b-84b6-2ddc75b6b947 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Created volume successfully.
Aug 29 13:18:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-243f40fe-00ed-4c91-b682-c405866fd98d tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-d5329722-bb1b-4458-9de1-84835886f316-delete_volume" released by "delete_volume" :: held 8.605s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:19 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2 1073741824" returned: 0 in 0.896s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:19 devstack sudo[96237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2
Aug 29 13:18:19 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Flow 'volume_create_manager' (92174b99-c375-4bc5-a784-ff4ab39ac8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e255d8c0-6de3-4e42-a4cf-a5f6c3c6ccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:19 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2" returned: 0 in 0.546s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e255d8c0-6de3-4e42-a4cf-a5f6c3c6ccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-419547150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8abfd2d-7086-4182-9051-a7dbac7e84a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b692d55014dd78f8bb8d85980c39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:20Z,use_quota=True,user_id='abcad9f684b04a5c889fcc8636d547c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97499ed8-5446-44f0-a5d9-f84e65c5733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97499ed8-5446-44f0-a5d9-f84e65c5733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2205471-d301-41ff-bcef-69beb390a30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2205471-d301-41ff-bcef-69beb390a30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8abfd2d-7086-4182-9051-a7dbac7e84a5', 'volume_name': 'volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19e5cf8-6d75-43a5-8f61-f16c94dbc8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19e5cf8-6d75-43a5-8f61-f16c94dbc8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6433aa96-3520-419c-831a-b26d2c9f3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:19 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Volume d8abfd2d-7086-4182-9051-a7dbac7e84a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5', 'volume_size': 1}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-419547150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8abfd2d-7086-4182-9051-a7dbac7e84a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b692d55014dd78f8bb8d85980c39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:20Z,use_quota=True,user_id='abcad9f684b04a5c889fcc8636d547c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Creating volume d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:18:19 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:18:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b18fee-c666-4890-824b-1cc52663ee0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d9d43b-e56f-4401-b529-afe84e9f07d2', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2cfe72-081c-4812-9845-d7915cb4c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:20 devstack sudo[96240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 1073741824
Aug 29 13:18:20 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:20 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Volume volume-64d9d43b-e56f-4401-b529-afe84e9f07d2 (64d9d43b-e56f-4401-b529-afe84e9f07d2): created successfully
Aug 29 13:18:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2cfe72-081c-4812-9845-d7915cb4c440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Flow 'volume_create_manager' (1271b04f-7ce6-42ba-91ef-1de61396be22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:20 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a72726c5-9b66-4b9b-9055-7b55a0d3f13c tempest-TestServerVolumeAttachmentScenario-1105822978 None] Created volume successfully.
Aug 29 13:18:20 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 1073741824" returned: 0 in 0.653s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:20 devstack sudo[96252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5
Aug 29 13:18:20 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:21 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5" returned: 0 in 0.372s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:18:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6433aa96-3520-419c-831a-b26d2c9f3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a2baed-7195-4f74-992a-cf8aee213e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:21 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Volume volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 (d8abfd2d-7086-4182-9051-a7dbac7e84a5): created successfully
Aug 29 13:18:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a2baed-7195-4f74-992a-cf8aee213e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Flow 'volume_create_manager' (92174b99-c375-4bc5-a784-ff4ab39ac8eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-157168b4-d897-47b0-a4eb-b4d8ad19f8cb tempest-VolumesDeleteCascade-1143821824 None] Created volume successfully.
Aug 29 13:18:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Creating offline snapshot 46e56008-745e-4808-bdcf-a3ac49782733 of volume d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:18:22 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f3ffc6-1054-492a-a231-434ad968609c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:22 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5
Aug 29 13:18:22 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:22 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5" returned: 0 in 0.648s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:22 devstack sudo[96310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 1G
Aug 29 13:18:22 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:23 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 1G" returned: 0 in 0.646s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:23 devstack sudo[96319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733
Aug 29 13:18:23 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:24 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733" returned: 0 in 0.556s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:24 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 is being set with open permissions: ugo+rw
Aug 29 13:18:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:24 devstack sudo[96324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733
Aug 29 13:18:24 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:24 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733" returned: 0 in 0.635s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:24 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.info
Aug 29 13:18:24 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:25 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.info" returned: 0 in 0.706s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:25 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.info is being set with open permissions: ugo+rw
Aug 29 13:18:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:25 devstack sudo[96386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.info
Aug 29 13:18:25 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:26 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.info" returned: 0 in 0.872s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9f5ea700-195d-4308-839a-ee1bdc834116 tempest-VolumesDeleteCascade-1143821824 None] Create snapshot completed successfully
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3e6a2a48-7a82-4b91-afa7-953879925683 tempest-VolumesActionsTest-1568861191 None] Acquiring lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc" by "attach_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3e6a2a48-7a82-4b91-afa7-953879925683 tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc" acquired by "attach_volume" :: waited 0.037s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Flow 'volume_create_manager' (3a5c3813-1950-46ba-8649-67394ee536a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91a79e7-55d5-4387-9fae-9155d0f1a6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91a79e7-55d5-4387-9fae-9155d0f1a6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1893167143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0de211-b555-43db-80ea-581d40d41128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b692d55014dd78f8bb8d85980c39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46e56008-745e-4808-bdcf-a3ac49782733,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:29Z,use_quota=True,user_id='abcad9f684b04a5c889fcc8636d547c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd928ad3-f01b-493f-8794-d43ce841f04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd928ad3-f01b-493f-8794-d43ce841f04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac1ff7b-bb12-421f-88c2-75cf62fbf9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac1ff7b-bb12-421f-88c2-75cf62fbf9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c0de211-b555-43db-80ea-581d40d41128', 'volume_name': 'volume-5c0de211-b555-43db-80ea-581d40d41128', 'volume_size': 1, 'snapshot_id': '46e56008-745e-4808-bdcf-a3ac49782733'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e342f88-ea6d-4451-9856-1b5599ad471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e342f88-ea6d-4451-9856-1b5599ad471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5978e1-b171-4c09-86a9-d341437769c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:29 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Volume 5c0de211-b555-43db-80ea-581d40d41128: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c0de211-b555-43db-80ea-581d40d41128', 'volume_size': 1, 'snapshot_id': '46e56008-745e-4808-bdcf-a3ac49782733'}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-46e56008-745e-4808-bdcf-a3ac49782733-5c0de211-b555-43db-80ea-581d40d41128" by "_create_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-46e56008-745e-4808-bdcf-a3ac49782733-5c0de211-b555-43db-80ea-581d40d41128" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Creating volume 5c0de211-b555-43db-80ea-581d40d41128 from snapshot 46e56008-745e-4808-bdcf-a3ac49782733 {{(pid=85771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-5c0de211-b555-43db-80ea-581d40d41128" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:29 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3e6a2a48-7a82-4b91-afa7-953879925683 tempest-VolumesActionsTest-1568861191 None] Attaching volume eeea61fc-6983-4819-bba7-12c8d93b34dc to instance 2318646b-81cf-4ba3-92bf-f15987f03a22 at mountpoint /dev/vdb on host None.
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-5c0de211-b555-43db-80ea-581d40d41128" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] snapshot: 46e56008-745e-4808-bdcf-a3ac49782733, volume: 5c0de211-b555-43db-80ea-581d40d41128,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:29 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3e6a2a48-7a82-4b91-afa7-953879925683 tempest-VolumesActionsTest-1568861191 None] Attach volume completed successfully.
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3e6a2a48-7a82-4b91-afa7-953879925683 tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc" released by "attach_volume" :: held 0.298s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[467b88c7-cac7-4af3-8a5b-148b5d257305]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7575de93-2963-4f89-a7cb-c8c080fac445 tempest-VolumesActionsTest-1568861191 None] Acquiring lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc-detach_volume" by "detach_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:29 devstack sudo[96427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733
Aug 29 13:18:29 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7575de93-2963-4f89-a7cb-c8c080fac445 tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:29 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7575de93-2963-4f89-a7cb-c8c080fac445 tempest-VolumesActionsTest-1568861191 None] Detaching volume eeea61fc-6983-4819-bba7-12c8d93b34dc from instance 2318646b-81cf-4ba3-92bf-f15987f03a22.
Aug 29 13:18:29 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7575de93-2963-4f89-a7cb-c8c080fac445 tempest-VolumesActionsTest-1568861191 None] Detach volume completed successfully.
Aug 29 13:18:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7575de93-2963-4f89-a7cb-c8c080fac445 tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:30 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733" returned: 0 in 0.877s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:18:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8d4083-6b9d-4ff0-b0ef-3b843103c745]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:30 devstack sudo[96434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5
Aug 29 13:18:30 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:31 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5" returned: 0 in 0.662s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:18:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:18:31 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128 not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:18:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:31 devstack sudo[96462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128
Aug 29 13:18:31 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128" returned: 0 in 8.573s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:39 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:18:39 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Converted 1024.00 MB image at 119.42 MB/s
Aug 29 13:18:39 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128 is being set with open permissions: ugo+rw
Aug 29 13:18:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:39 devstack sudo[96583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128
Aug 29 13:18:39 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:39 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=23,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:18:39 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=43,cinder:DELETE=5,cinder:SELECT=46,cinder:INSERT=10 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:18:40 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128" returned: 0 in 0.674s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-5c0de211-b555-43db-80ea-581d40d41128" released by "_copy_volume_from_snapshot" :: held 10.989s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-46e56008-745e-4808-bdcf-a3ac49782733-5c0de211-b555-43db-80ea-581d40d41128" released by "_create_volume_from_snapshot" :: held 11.116s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.141s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5978e1-b171-4c09-86a9-d341437769c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c0de211-b555-43db-80ea-581d40d41128', 'volume_size': 1, 'snapshot_id': '46e56008-745e-4808-bdcf-a3ac49782733'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52abc355-70ac-48c8-89aa-c8bac75b69b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:40 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Volume volume-5c0de211-b555-43db-80ea-581d40d41128 (5c0de211-b555-43db-80ea-581d40d41128): created successfully
Aug 29 13:18:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52abc355-70ac-48c8-89aa-c8bac75b69b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Flow 'volume_create_manager' (3a5c3813-1950-46ba-8649-67394ee536a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-cf157c4f-ae28-462b-925c-8b41a99a5c62 tempest-VolumesDeleteCascade-1143821824 None] Created volume successfully.
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-d8abfd2d-7086-4182-9051-a7dbac7e84a5-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-d8abfd2d-7086-4182-9051-a7dbac7e84a5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Performing cascade delete. {{(pid=85771) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-46e56008-745e-4808-bdcf-a3ac49782733-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-46e56008-745e-4808-bdcf-a3ac49782733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-d8abfd2d-7086-4182-9051-a7dbac7e84a5" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d8abfd2d-7086-4182-9051-a7dbac7e84a5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-46e56008-745e-4808-bdcf-a3ac49782733" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-46e56008-745e-4808-bdcf-a3ac49782733" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Deleting offline snapshot 46e56008-745e-4808-bdcf-a3ac49782733 of volume d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] snapshot_file for this snap is: volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[be828600-44a3-439a-9a08-0551ee56a37e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:41 devstack sudo[96594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733
Aug 29 13:18:41 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:42 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733" returned: 0 in 0.472s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:18:42 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb93deb-76d8-4dac-99b8-fb8d23603a24]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:42 devstack sudo[96600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5
Aug 29 13:18:42 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:42 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5" returned: 0 in 0.789s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:43 devstack sudo[96620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733
Aug 29 13:18:43 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:43 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733" returned: 0 in 0.490s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:43 devstack sudo[96629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733
Aug 29 13:18:43 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:43 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5.46e56008-745e-4808-bdcf-a3ac49782733" returned: 0 in 0.304s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-46e56008-745e-4808-bdcf-a3ac49782733" released by "_delete_snapshot" :: held 2.188s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d8abfd2d-7086-4182-9051-a7dbac7e84a5" released by "delete_snapshot" :: held 2.214s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:43 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Created reservations ['258534f2-9817-4d88-ba59-d7961fbc9a77', '7db571de-a894-448e-8a27-e7c83436c3ee', '8e10c5dd-146a-49f6-a491-92b57d287aa8', '09afd90e-aa72-48cd-bbce-053e56b41857'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:18:44 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Delete snapshot completed successfully.
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-46e56008-745e-4808-bdcf-a3ac49782733-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Snapshots deleted, issuing volume delete {{(pid=85771) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-d8abfd2d-7086-4182-9051-a7dbac7e84a5" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d8abfd2d-7086-4182-9051-a7dbac7e84a5" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa7580-35f4-4773-be44-425512d11a0d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:44 devstack sudo[96633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5
Aug 29 13:18:44 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:44 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5" returned: 0 in 0.515s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:44 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5
Aug 29 13:18:44 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:44 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d8abfd2d-7086-4182-9051-a7dbac7e84a5" returned: 0 in 0.297s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-d8abfd2d-7086-4182-9051-a7dbac7e84a5" released by "delete_volume" :: held 0.891s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:44 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Created reservations ['dc64b021-ec99-46da-964a-8b5989f5fbff', '069337b2-3f7f-4c2d-a09a-195ab1b7c02d', 'ea1e88cb-330f-4b72-acc0-8b29afec5b5a', '3542452d-07a1-4f15-83f8-19dcc74087f4'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:18:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:45 devstack sudo[96645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:18:45 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:45 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.424s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:45 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:18:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Deleted volume successfully.
Aug 29 13:18:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b69e7abb-10d1-4206-9d52-caee29f0f64f tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-d8abfd2d-7086-4182-9051-a7dbac7e84a5-delete_volume" released by "delete_volume" :: held 4.085s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-5c0de211-b555-43db-80ea-581d40d41128-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-5c0de211-b555-43db-80ea-581d40d41128-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "cinder-quobyte-5c0de211-b555-43db-80ea-581d40d41128" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-5c0de211-b555-43db-80ea-581d40d41128" acquired by "delete_volume" :: waited 0.052s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:46 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ecd419-12b0-452f-b2ef-ef033502c749]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:46 devstack sudo[96711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128
Aug 29 13:18:46 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:47 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128" returned: 0 in 0.460s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:47 devstack sudo[96720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128
Aug 29 13:18:47 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:47 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5c0de211-b555-43db-80ea-581d40d41128" returned: 0 in 0.432s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-quobyte-5c0de211-b555-43db-80ea-581d40d41128" released by "delete_volume" :: held 1.036s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Created reservations ['e930883d-6dfd-44aa-a5be-66b74c9b86d6', '069f9c9f-d71e-48e7-9f9b-3a9c53dc9828', '6d58c884-d312-4abf-94ee-5242ddad232c', 'e07d0942-eff4-42a9-a5d8-e3159cf5521b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:47 devstack sudo[96726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:18:47 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:48 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.272s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:48 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:18:48 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Deleted volume successfully.
Aug 29 13:18:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-018da666-372f-435d-81d6-3fa4c85da590 tempest-VolumesDeleteCascade-1143821824 None] Lock "cinder-5c0de211-b555-43db-80ea-581d40d41128-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d5531a85-b8f0-4ace-959f-86535e90895d tempest-VolumesActionsTest-1568861191 None] Acquiring lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc" by "attach_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d5531a85-b8f0-4ace-959f-86535e90895d tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc" acquired by "attach_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:48 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d5531a85-b8f0-4ace-959f-86535e90895d tempest-VolumesActionsTest-1568861191 None] Attaching volume eeea61fc-6983-4819-bba7-12c8d93b34dc to instance 1206f9e7-71ef-4b65-b30b-590d4819d291 at mountpoint /dev/vdb on host None.
Aug 29 13:18:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d5531a85-b8f0-4ace-959f-86535e90895d tempest-VolumesActionsTest-1568861191 None] Attach volume completed successfully.
Aug 29 13:18:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d5531a85-b8f0-4ace-959f-86535e90895d tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc" released by "attach_volume" :: held 0.099s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0ef3384d-3abd-4162-877b-b3c95f82ebfd tempest-VolumesActionsTest-1568861191 None] Acquiring lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc-detach_volume" by "detach_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0ef3384d-3abd-4162-877b-b3c95f82ebfd tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0ef3384d-3abd-4162-877b-b3c95f82ebfd tempest-VolumesActionsTest-1568861191 None] Detaching volume eeea61fc-6983-4819-bba7-12c8d93b34dc from instance 1206f9e7-71ef-4b65-b30b-590d4819d291.
Aug 29 13:18:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0ef3384d-3abd-4162-877b-b3c95f82ebfd tempest-VolumesActionsTest-1568861191 None] Detach volume completed successfully.
Aug 29 13:18:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0ef3384d-3abd-4162-877b-b3c95f82ebfd tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Flow 'volume_create_manager' (576315b5-5965-445e-b9b8-a3e8b9989d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8192e9a3-bb43-4b45-9eb8-49ec68885b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8192e9a3-bb43-4b45-9eb8-49ec68885b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1872035004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c849c82f-a352-4423-a0fc-a1b73826a37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ad4aa9d8a423cabc032414c9ece17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:54Z,use_quota=True,user_id='774915a621414e5ebbb6398f86333987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7ae22d-1e9e-4fa7-93c2-782e7d002d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7ae22d-1e9e-4fa7-93c2-782e7d002d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb45e7c-6522-49e8-a32e-2ef57358f183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb45e7c-6522-49e8-a32e-2ef57358f183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c849c82f-a352-4423-a0fc-a1b73826a37d', 'volume_name': 'volume-c849c82f-a352-4423-a0fc-a1b73826a37d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f71b36-1f5a-43ca-b1d8-022d61971173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f71b36-1f5a-43ca-b1d8-022d61971173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c317ca-941f-4d8e-9fed-494d1a4dd2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Volume c849c82f-a352-4423-a0fc-a1b73826a37d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c849c82f-a352-4423-a0fc-a1b73826a37d', 'volume_size': 1}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1872035004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c849c82f-a352-4423-a0fc-a1b73826a37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ad4aa9d8a423cabc032414c9ece17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:18:54Z,use_quota=True,user_id='774915a621414e5ebbb6398f86333987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Creating volume c849c82f-a352-4423-a0fc-a1b73826a37d {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:18:53 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:18:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:53 devstack sudo[96778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d 1073741824
Aug 29 13:18:53 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-74fa49b2-a240-4769-a7d2-f5d29507d2d9 req-8c08eb1c-870d-481f-b216-20f678e7ea4b tempest-AttachVolumeTestJSON-2067344242 None] Terminate volume connection completed successfully.
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-74fa49b2-a240-4769-a7d2-f5d29507d2d9 req-8c08eb1c-870d-481f-b216-20f678e7ea4b tempest-AttachVolumeTestJSON-2067344242 None] Deleting attachment 84487fdd-a0fc-4a38-8969-38700cce7da8. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:18:54 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d 1073741824" returned: 0 in 0.493s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:54 devstack sudo[96787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d
Aug 29 13:18:54 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:54 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d" returned: 0 in 0.253s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.548s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:18:54 devstack sudo[96791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:18:54 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c317ca-941f-4d8e-9fed-494d1a4dd2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c849c82f-a352-4423-a0fc-a1b73826a37d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e17f4d7-2cd1-45a8-b06c-b62ca544e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de6fc87-9d78-4841-bf9f-26873be98967]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:54 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Volume volume-c849c82f-a352-4423-a0fc-a1b73826a37d (c849c82f-a352-4423-a0fc-a1b73826a37d): created successfully
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e17f4d7-2cd1-45a8-b06c-b62ca544e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Flow 'volume_create_manager' (576315b5-5965-445e-b9b8-a3e8b9989d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:18:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-807217a6-befe-4c86-9236-70a0eec8cd12 tempest-VolumesTransfersV355Test-1335561135 None] Created volume successfully.
Aug 29 13:18:54 devstack sudo[96793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc
Aug 29 13:18:54 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:54 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.269s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:18:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:18:55 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc" returned: 0 in 0.389s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:55 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd253bc-e4d2-4daa-8408-cd28435d8d1d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:55 devstack sudo[96799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc
Aug 29 13:18:55 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:55 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root
Aug 29 13:18:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc" returned: 0 in 0.418s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:18:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.c841ac5c-2c0a-4b01-a460-836c930feb503nx31q9d.img {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:55 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.c841ac5c-2c0a-4b01-a460-836c930feb503nx31q9d.img
Aug 29 13:18:55 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:18:57 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1cbacff5-c7a1-4591-8445-ca2078ffac6c tempest-VolumesTransfersV355Test-799793541 None] Transfer volume completed successfully.
Aug 29 13:18:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Acquiring lock "cinder-c849c82f-a352-4423-a0fc-a1b73826a37d-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "cinder-c849c82f-a352-4423-a0fc-a1b73826a37d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Acquiring lock "cinder-quobyte-c849c82f-a352-4423-a0fc-a1b73826a37d" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:18:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "cinder-quobyte-c849c82f-a352-4423-a0fc-a1b73826a37d" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:18:59 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[54acf5a7-37d0-4f93-b0e4-1fcdbb052fe1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:18:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:18:59 devstack sudo[96822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d
Aug 29 13:18:59 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:00 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d" returned: 0 in 0.721s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:00 devstack sudo[96829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d
Aug 29 13:19:00 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:00 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c849c82f-a352-4423-a0fc-a1b73826a37d" returned: 0 in 0.688s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "cinder-quobyte-c849c82f-a352-4423-a0fc-a1b73826a37d" released by "delete_volume" :: held 1.538s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Created reservations ['da291183-a592-4457-a4d4-0b5aa62aab99', '26deb6ec-8059-4df4-b554-89dd4b4d908f', 'c279b64e-3794-4c83-b658-3c5f2b683625', 'e12b1681-a978-44b7-b742-beb5c48738c4'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:01 devstack sudo[96851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:19:01 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:01 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.c841ac5c-2c0a-4b01-a460-836c930feb503nx31q9d.img" returned: 0 in 6.235s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d5aa30-6c7d-4e1a-9a51-7b5ea1a0cfd9]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:01 devstack sudo[96854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc
Aug 29 13:19:01 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:02 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.478s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:19:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Deleted volume successfully.
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b1dbb1b-e578-4fb0-9a1e-cbbb26b6b1e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "cinder-c849c82f-a352-4423-a0fc-a1b73826a37d-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:02 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Flow 'volume_create_manager' (7cd35b28-3cdc-4402-8864-a1f27bce0704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d57e1b-0a5a-417f-89bb-b930e58a9270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc" returned: 0 in 1.145s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.c841ac5c-2c0a-4b01-a460-836c930feb503nx31q9d.img {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:19:02 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Converted 1024.00 MB image at 164.20 MB/s
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] c841ac5c-2c0a-4b01-a460-836c930feb50 was raw, no need to convert to raw {{(pid=85771) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d57e1b-0a5a-417f-89bb-b930e58a9270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1161451288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd318bf-fd62-4e9f-95d7-6bc30022daac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ad4aa9d8a423cabc032414c9ece17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:19:03Z,use_quota=True,user_id='774915a621414e5ebbb6398f86333987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e4effa-f29c-4f0b-a800-0c37bcffc0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e4effa-f29c-4f0b-a800-0c37bcffc0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f680ae00-a681-4b79-a46a-72e20f82c787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f680ae00-a681-4b79-a46a-72e20f82c787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd318bf-fd62-4e9f-95d7-6bc30022daac', 'volume_name': 'volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78f31ef-f505-4723-9bce-23fa25293597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78f31ef-f505-4723-9bce-23fa25293597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f306ff3d-e923-483c-a352-b7b4741d1dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:02 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Volume 5cd318bf-fd62-4e9f-95d7-6bc30022daac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac', 'volume_size': 1}
Aug 29 13:19:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-4cfc9aa6-efd9-4053-b8fc-4383916d0088 req-d2fb021c-db51-43d4-836e-a7a52d9b42f2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:13 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=34,cinder:INSERT=11,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:19:13 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=46,cinder:SELECT=37,cinder:DELETE=4,cinder:INSERT=9 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.747s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Uploaded volume to glance image-id: c841ac5c-2c0a-4b01-a460-836c930feb50. {{(pid=85771) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.400s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1161451288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd318bf-fd62-4e9f-95d7-6bc30022daac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ad4aa9d8a423cabc032414c9ece17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:19:03Z,use_quota=True,user_id='774915a621414e5ebbb6398f86333987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Creating volume 5cd318bf-fd62-4e9f-95d7-6bc30022daac {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:19:22 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:22 devstack sudo[96994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac 1073741824
Aug 29 13:19:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5799381a-2de2-4fd7-9bbd-a181468729a2 tempest-VolumesActionsTest-1568861191 None] Copy volume to image completed successfully.
Aug 29 13:19:22 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:22 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac 1073741824" returned: 0 in 0.468s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:22 devstack sudo[97001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac
Aug 29 13:19:22 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:23 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac" returned: 0 in 0.250s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-4cfc9aa6-efd9-4053-b8fc-4383916d0088 req-d2fb021c-db51-43d4-836e-a7a52d9b42f2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.433s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f306ff3d-e923-483c-a352-b7b4741d1dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dd273d-bbb5-4df0-a7ab-026e9c34f900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-4cfc9aa6-efd9-4053-b8fc-4383916d0088 req-d2fb021c-db51-43d4-836e-a7a52d9b42f2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:23 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Volume volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac (5cd318bf-fd62-4e9f-95d7-6bc30022daac): created successfully
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dd273d-bbb5-4df0-a7ab-026e9c34f900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Flow 'volume_create_manager' (7cd35b28-3cdc-4402-8864-a1f27bce0704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:19:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fba0f2ee-b28a-47ad-8a8e-c065c8934f39 tempest-VolumesTransfersV355Test-1335561135 None] Created volume successfully.
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-4cfc9aa6-efd9-4053-b8fc-4383916d0088 req-d2fb021c-db51-43d4-836e-a7a52d9b42f2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-6268d7ec-6abd-4b63-ac8e-2395077fd639', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dea665c-473c-4620-a1cb-ac5ae85239f4', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:19:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-4cfc9aa6-efd9-4053-b8fc-4383916d0088 req-d2fb021c-db51-43d4-836e-a7a52d9b42f2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] attachment_update completed successfully.
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[547e5f8b-d12b-4f08-ab51-d3673002aac1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:23 devstack sudo[97069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc
Aug 29 13:19:23 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Acquiring lock "cinder-5cd318bf-fd62-4e9f-95d7-6bc30022daac-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "cinder-5cd318bf-fd62-4e9f-95d7-6bc30022daac-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Acquiring lock "cinder-quobyte-5cd318bf-fd62-4e9f-95d7-6bc30022daac" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "cinder-quobyte-5cd318bf-fd62-4e9f-95d7-6bc30022daac" acquired by "delete_volume" :: waited 0.041s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c6d08-3206-4cf9-b548-6457c88d4e7d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:24 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc" returned: 0 in 0.524s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd47f6c-6bb0-4de1-b1fa-ae9d104d161b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:24 devstack sudo[97392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac
Aug 29 13:19:24 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:24 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc
Aug 29 13:19:24 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:24 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac" returned: 0 in 0.433s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:24 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc" returned: 0 in 0.408s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:24 devstack sudo[97402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac
Aug 29 13:19:24 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:24 devstack sudo[97403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img
Aug 29 13:19:24 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:24 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-5cd318bf-fd62-4e9f-95d7-6bc30022daac" returned: 0 in 0.323s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "cinder-quobyte-5cd318bf-fd62-4e9f-95d7-6bc30022daac" released by "delete_volume" :: held 0.816s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:24 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Created reservations ['6720c397-78ae-40a6-9945-945a51ff5e77', '182d547b-483f-4b9b-af2f-3ab07bab4929', '091f1723-25ec-40d1-8709-174eb93ab6b5', '209da388-91f8-4820-aea2-867e55ef3102'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:19:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:25 devstack sudo[97419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:19:25 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:26 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.941s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:26 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:19:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Deleted volume successfully.
Aug 29 13:19:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66da0e2c-e77c-4adc-90be-7242dacbf4e6 tempest-VolumesTransfersV355Test-1888622798 None] Lock "cinder-5cd318bf-fd62-4e9f-95d7-6bc30022daac-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:31 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img" returned: 0 in 6.626s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:31 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd931647-dd01-481f-9acb-e9526d088933]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:31 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc
Aug 29 13:19:31 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:31 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc" returned: 0 in 0.854s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:31 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:19:31 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Converted 1024.00 MB image at 154.52 MB/s
Aug 29 13:19:32 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] 88c2e150-e09a-49d4-a16a-875533559d46 was raw, converting to qcow2 {{(pid=85771) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Aug 29 13:19:32 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e141c3b5-dd7e-4d6a-a165-e07f3d3fc3fb]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:32 devstack sudo[97462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img
Aug 29 13:19:32 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:32 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img" returned: 0 in 0.511s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:32 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img
Aug 29 13:19:32 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:33 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img" returned: 1 in 0.489s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:19:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img /opt/stack/data/cinder/conversion/vol_upload__nz7v3w6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:33 devstack sudo[97477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img /opt/stack/data/cinder/conversion/vol_upload__nz7v3w6
Aug 29 13:19:33 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:33 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img /opt/stack/data/cinder/conversion/vol_upload__nz7v3w6" returned: 0 in 0.342s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:33 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Image conversion details: src /opt/stack/data/cinder/conversion/eeea61fc-6983-4819-bba7-12c8d93b34dc.temp_image.88c2e150-e09a-49d4-a16a-875533559d46rqltekb8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__nz7v3w6 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:19:33 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Converted 1024.00 MB image at 1024.00 MB/s
Aug 29 13:19:33 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2ee2fb-2f31-417a-a740-e2ce23fa228f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__nz7v3w6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:33 devstack sudo[97484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__nz7v3w6
Aug 29 13:19:33 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:33 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__nz7v3w6" returned: 0 in 0.416s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-5ba9406e-5a2e-4867-83c4-5c50d49389fb req-d72607ae-3820-4bde-ba04-80639313aef2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.963s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Uploaded volume to glance image-id: 88c2e150-e09a-49d4-a16a-875533559d46. {{(pid=85771) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 29 13:19:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-5ba9406e-5a2e-4867-83c4-5c50d49389fb req-d72607ae-3820-4bde-ba04-80639313aef2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.508s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-5ba9406e-5a2e-4867-83c4-5c50d49389fb req-d72607ae-3820-4bde-ba04-80639313aef2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:35 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-626394d4-dea2-415e-ae58-cbd0d8b44778 tempest-VolumesActionsTest-1568861191 None] Copy volume to image completed successfully.
Aug 29 13:19:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-5ba9406e-5a2e-4867-83c4-5c50d49389fb req-d72607ae-3820-4bde-ba04-80639313aef2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-64d9d43b-e56f-4401-b529-afe84e9f07d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a365a958-fe48-4908-8c0e-70508d1ebf54', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:19:35 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-5ba9406e-5a2e-4867-83c4-5c50d49389fb req-d72607ae-3820-4bde-ba04-80639313aef2 tempest-TestServerVolumeAttachmentScenario-1105822978 None] attachment_update completed successfully.
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Flow 'volume_create_manager' (e197a09f-3762-46fa-b148-c00b00aac9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3826bf1-1f5a-4416-982c-4b259652aeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3826bf1-1f5a-4416-982c-4b259652aeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1715136530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d24458-aefc-499b-b01c-2e75d7b69d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdfc98b6e874650a9c3dec0f9345be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:19:36Z,use_quota=True,user_id='c76546077093470e8351561859c85af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d1019-ea9c-4c55-815d-1cd65c914df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d1019-ea9c-4c55-815d-1cd65c914df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65300e84-8735-4b56-ae0c-b06e0d034716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65300e84-8735-4b56-ae0c-b06e0d034716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6d24458-aefc-499b-b01c-2e75d7b69d85', 'volume_name': 'volume-b6d24458-aefc-499b-b01c-2e75d7b69d85', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b61656d040>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0478a7a-8b15-4cbc-8de4-87afc478c357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0478a7a-8b15-4cbc-8de4-87afc478c357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6f4da0-9351-481f-b046-4c12bfc9e322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:36 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Volume b6d24458-aefc-499b-b01c-2e75d7b69d85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6d24458-aefc-499b-b01c-2e75d7b69d85', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b61656d040>}
Aug 29 13:19:36 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Trying to clone b6d24458-aefc-499b-b01c-2e75d7b69d85 from image 9ccc8465-2a9b-49d5-8097-23b2336c201f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:19:37 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Image download 20.69 MB at 20.69 MB/s
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Acquiring lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a401141-08f2-4932-b75e-14286ea3f85c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Acquiring lock "cinder-quobyte-eeea61fc-6983-4819-bba7-12c8d93b34dc" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Lock "cinder-quobyte-eeea61fc-6983-4819-bba7-12c8d93b34dc" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a34ad4-059e-4931-b99d-c9d02b51f26c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:37 devstack sudo[97500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD
Aug 29 13:19:37 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:37 devstack sudo[97501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc
Aug 29 13:19:37 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:37 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f is fetched for user c76546077093470e8351561859c85af0. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ec0d55-057b-4bda-9894-2865f9fe1251]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:37 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc" returned: 0 in 0.521s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:37 devstack sudo[97514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc
Aug 29 13:19:37 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:37 devstack sudo[97511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD
Aug 29 13:19:37 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:37 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-6f10aeac-7788-428c-b2cc-f241fd53a3fc req-3620f677-23b0-445f-91d2-4b449f943f9d tempest-TestServerVolumeAttachmentScenario-1105822978 None] Terminate volume connection completed successfully.
Aug 29 13:19:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-6f10aeac-7788-428c-b2cc-f241fd53a3fc req-3620f677-23b0-445f-91d2-4b449f943f9d tempest-TestServerVolumeAttachmentScenario-1105822978 None] Deleting attachment a365a958-fe48-4908-8c0e-70508d1ebf54. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:19:38 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1715136530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d24458-aefc-499b-b01c-2e75d7b69d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdfc98b6e874650a9c3dec0f9345be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:19:36Z,use_quota=True,user_id='c76546077093470e8351561859c85af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Creating volume b6d24458-aefc-499b-b01c-2e75d7b69d85 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:19:38 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:38 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eeea61fc-6983-4819-bba7-12c8d93b34dc" returned: 0 in 0.362s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:38 devstack sudo[97521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 1073741824
Aug 29 13:19:38 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Lock "cinder-quobyte-eeea61fc-6983-4819-bba7-12c8d93b34dc" released by "delete_volume" :: held 0.936s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Created reservations ['2c997f45-bf19-4a7d-bb02-18223cc74492', '89fa60d3-fe39-4aa1-af8c-be60455ebd9f', '6866d8c0-4dca-4929-bbd0-20025422b5c6', '14636d0d-97b7-46be-b433-346de9a34177'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:38 devstack sudo[97523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:19:38 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:38 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.310s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:19:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Deleted volume successfully.
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-caf8ba98-12c2-455a-bec3-f14a6ad7582a tempest-VolumesActionsTest-1568861191 None] Lock "cinder-eeea61fc-6983-4819-bba7-12c8d93b34dc-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:38 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 1073741824" returned: 0 in 0.582s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:38 devstack sudo[97530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85
Aug 29 13:19:38 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:39 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85" returned: 0 in 0.309s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:19:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:39 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Attempting download of 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume b6d24458-aefc-499b-b01c-2e75d7b69d85. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:19:39 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fe83e0-5e61-454e-ac76-8ea1ab2d6654]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_38xlvaos {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:39 devstack sudo[97533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_38xlvaos
Aug 29 13:19:39 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:39 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-30b5ed67-724d-49b0-8470-8142dfe79c2f req-ff36c4cd-819f-4b0e-b8df-532c11227b30 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Terminate volume connection completed successfully.
Aug 29 13:19:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-30b5ed67-724d-49b0-8470-8142dfe79c2f req-ff36c4cd-819f-4b0e-b8df-532c11227b30 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Deleting attachment 3dea665c-473c-4620-a1cb-ac5ae85239f4. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:19:39 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_38xlvaos" returned: 0 in 0.426s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_38xlvaos {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:39 devstack sudo[97568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_38xlvaos
Aug 29 13:19:39 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:40 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_38xlvaos" returned: 1 in 0.363s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_38xlvaos' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:19:40 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f015cd-e866-41d5-934d-af97ee1041ef]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:40 devstack sudo[97575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD
Aug 29 13:19:40 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:40 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:40 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] 9ccc8465-2a9b-49d5-8097-23b2336c201f was qcow2, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:19:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:40 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85
Aug 29 13:19:40 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:43 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85" returned: 0 in 2.643s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_84tnzc8wdevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:19:43 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Converted 112.00 MB image at 42.33 MB/s
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:43 devstack sudo[97634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 1G
Aug 29 13:19:43 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:43 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 1G" returned: 0 in 0.407s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Downloaded image 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume b6d24458-aefc-499b-b01c-2e75d7b69d85 successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f for user c76546077093470e8351561859c85af0 is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Marking volume b6d24458-aefc-499b-b01c-2e75d7b69d85 as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Copying metadata from image 9ccc8465-2a9b-49d5-8097-23b2336c201f to b6d24458-aefc-499b-b01c-2e75d7b69d85. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Creating volume glance metadata for volume b6d24458-aefc-499b-b01c-2e75d7b69d85 backed by image 9ccc8465-2a9b-49d5-8097-23b2336c201f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6f4da0-9351-481f-b046-4c12bfc9e322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d24458-aefc-499b-b01c-2e75d7b69d85', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b61656d040>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511a6768-6467-4c2f-bbda-62493914fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:43 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Volume volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 (b6d24458-aefc-499b-b01c-2e75d7b69d85): created successfully
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511a6768-6467-4c2f-bbda-62493914fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Flow 'volume_create_manager' (e197a09f-3762-46fa-b148-c00b00aac9d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:19:43 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fe0adba4-f928-4f1a-8ec9-e4dcd8fdb040 tempest-VolumesExtendTest-1311793697 None] Created volume successfully.
Aug 29 13:19:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-12ac7c2e-abdd-4c7a-8493-032b7d8d4ab4 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-12ac7c2e-abdd-4c7a-8493-032b7d8d4ab4 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:45 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b549f-8578-4150-abef-16e6929240e6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-12ac7c2e-abdd-4c7a-8493-032b7d8d4ab4 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:45 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85
Aug 29 13:19:45 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:45 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-12ac7c2e-abdd-4c7a-8493-032b7d8d4ab4 tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85" returned: 0 in 0.451s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-12ac7c2e-abdd-4c7a-8493-032b7d8d4ab4 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 2G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-12ac7c2e-abdd-4c7a-8493-032b7d8d4ab4 tempest-VolumesExtendTest-1311793697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 2G" returned: 0 in 0.138s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-12ac7c2e-abdd-4c7a-8493-032b7d8d4ab4 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.623s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-12ac7c2e-abdd-4c7a-8493-032b7d8d4ab4 tempest-VolumesExtendTest-1311793697 None] Extend volume completed successfully.
Aug 29 13:19:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "cinder-b6d24458-aefc-499b-b01c-2e75d7b69d85-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Lock "cinder-b6d24458-aefc-499b-b01c-2e75d7b69d85-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "cinder-quobyte-b6d24458-aefc-499b-b01c-2e75d7b69d85" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Lock "cinder-quobyte-b6d24458-aefc-499b-b01c-2e75d7b69d85" acquired by "delete_volume" :: waited 0.053s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:46 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d5bdc-8932-4ad9-b78b-d4c141f0732d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:47 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85
Aug 29 13:19:47 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:47 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85" returned: 0 in 0.880s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:47 devstack sudo[97722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85
Aug 29 13:19:47 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "cinder-64d9d43b-e56f-4401-b529-afe84e9f07d2-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "cinder-64d9d43b-e56f-4401-b529-afe84e9f07d2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "cinder-quobyte-64d9d43b-e56f-4401-b529-afe84e9f07d2" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "cinder-quobyte-64d9d43b-e56f-4401-b529-afe84e9f07d2" acquired by "delete_volume" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:47 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a8f098-7836-444f-92f5-55efe0a45133]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:48 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2
Aug 29 13:19:48 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:48 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b6d24458-aefc-499b-b01c-2e75d7b69d85" returned: 0 in 0.472s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Lock "cinder-quobyte-b6d24458-aefc-499b-b01c-2e75d7b69d85" released by "delete_volume" :: held 1.439s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Created reservations ['6f27662c-3bf0-40ce-a064-c951e14bb405', '4a001992-6345-4425-b6ed-bf593823534c', '9138c51f-11f0-4d15-bad4-d78648796aea', 'bd5f3dd3-8113-4650-bd26-7d4a3cd3b720'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:48 devstack sudo[97732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:19:48 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:48 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2" returned: 0 in 0.672s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:48 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2
Aug 29 13:19:48 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:48 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.498s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:48 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:19:48 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Deleted volume successfully.
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d9d83126-020d-4fb7-b9b5-9b5418520d07 tempest-VolumesExtendTest-1311793697 None] Lock "cinder-b6d24458-aefc-499b-b01c-2e75d7b69d85-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:49 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d9d43b-e56f-4401-b529-afe84e9f07d2" returned: 0 in 0.574s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "cinder-quobyte-64d9d43b-e56f-4401-b529-afe84e9f07d2" released by "delete_volume" :: held 1.332s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Created reservations ['8184d9dc-f065-4042-b372-3bf917dc1907', 'c9f0179f-a956-4259-b189-f2a02dbb4c72', '96788cb5-fb9d-4a27-9a01-f4edd0438d6d', 'c24959f1-ae17-44a8-a111-4fddd3c6f3aa'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:49 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:19:49 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "cinder-6268d7ec-6abd-4b63-ac8e-2395077fd639-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "cinder-6268d7ec-6abd-4b63-ac8e-2395077fd639-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Flow 'volume_create_manager' (c87b5514-bcc2-4bf5-81ad-d59b674e0f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c20d42a-de6d-4ab3-b06a-0e2a1dc0bc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c20d42a-de6d-4ab3-b06a-0e2a1dc0bc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2068225041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d67fcf7-ba39-4f69-b922-b0a0c28ec730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b71218383f24b92a20a82e2525313ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:19:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:19:50Z,use_quota=True,user_id='284b1c1cefac41dba5c35c41f8e0f2c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cacb7b-97b4-4ad3-b772-20ada91d58fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cacb7b-97b4-4ad3-b772-20ada91d58fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97cf103c-f73c-4bd9-b8a9-733e416da7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97cf103c-f73c-4bd9-b8a9-733e416da7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d67fcf7-ba39-4f69-b922-b0a0c28ec730', 'volume_name': 'volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730', 'volume_size': 2}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5426f02d-b2f3-461f-b151-51fa8e88e21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5426f02d-b2f3-461f-b151-51fa8e88e21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e898f6-fb2b-4530-85c2-442057866c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:49 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Volume 9d67fcf7-ba39-4f69-b922-b0a0c28ec730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730', 'volume_size': 2}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2068225041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d67fcf7-ba39-4f69-b922-b0a0c28ec730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b71218383f24b92a20a82e2525313ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:19:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:19:50Z,use_quota=True,user_id='284b1c1cefac41dba5c35c41f8e0f2c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Creating volume 9d67fcf7-ba39-4f69-b922-b0a0c28ec730 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:49 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:19:49 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730 2147483648 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "cinder-quobyte-6268d7ec-6abd-4b63-ac8e-2395077fd639" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:49 devstack sudo[97742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730 2147483648
Aug 29 13:19:49 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.579s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:49 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:19:50 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Deleted volume successfully.
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "cinder-quobyte-6268d7ec-6abd-4b63-ac8e-2395077fd639" acquired by "delete_volume" :: waited 0.060s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Flow 'volume_create_manager' (f8d0c21c-fc53-4a61-9d92-41e3bf5df7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbd58bd-a78c-4895-9eb6-fae487855ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd176725-cb34-4ac9-9247-6f502fd1b838]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbd58bd-a78c-4895-9eb6-fae487855ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1913103481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d62839-2cc3-4989-a206-475091813d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdfc98b6e874650a9c3dec0f9345be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:19:50Z,use_quota=True,user_id='c76546077093470e8351561859c85af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8382afb5-2b1a-4b88-9943-096ee051e1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8382afb5-2b1a-4b88-9943-096ee051e1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1fc9d6-d0de-42e8-8de9-207ebc6cb720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1fc9d6-d0de-42e8-8de9-207ebc6cb720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d62839-2cc3-4989-a206-475091813d95', 'volume_name': 'volume-58d62839-2cc3-4989-a206-475091813d95', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9493c56-352f-4ca1-87c3-445d26bd9bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9493c56-352f-4ca1-87c3-445d26bd9bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9343e5-25ee-4dd7-822b-908cee0092f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:50 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Volume 58d62839-2cc3-4989-a206-475091813d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d62839-2cc3-4989-a206-475091813d95', 'volume_size': 1}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-028300b6-bb03-4089-b4b8-2ea085a10b33 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "cinder-64d9d43b-e56f-4401-b529-afe84e9f07d2-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:50 devstack sudo[97744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639
Aug 29 13:19:50 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:50 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730 2147483648" returned: 0 in 0.717s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:50 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639" returned: 0 in 0.550s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:50 devstack sudo[97753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639
Aug 29 13:19:50 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:50 devstack sudo[97755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730
Aug 29 13:19:50 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:50 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6268d7ec-6abd-4b63-ac8e-2395077fd639" returned: 0 in 0.343s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "cinder-quobyte-6268d7ec-6abd-4b63-ac8e-2395077fd639" released by "delete_volume" :: held 0.998s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Created reservations ['2f50d0a2-3f4c-4516-958a-7d1d9e9622d6', 'db6fd0ba-92b5-46ee-a742-8f15633f228b', '3645f112-9ac9-4daa-b0ba-db14fa93cb00', '175d3f51-4f7a-46a7-9c33-56becd994185'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:19:51 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730" returned: 0 in 0.420s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.901s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1913103481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d62839-2cc3-4989-a206-475091813d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdfc98b6e874650a9c3dec0f9345be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:19:50Z,use_quota=True,user_id='c76546077093470e8351561859c85af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Creating volume 58d62839-2cc3-4989-a206-475091813d95 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:19:51 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e898f6-fb2b-4530-85c2-442057866c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730', 'volume_size': 2}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26baceb-2ad6-4564-8d69-8d0013b00044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:51 devstack sudo[97759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95 1073741824
Aug 29 13:19:51 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:51 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Volume volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730 (9d67fcf7-ba39-4f69-b922-b0a0c28ec730): created successfully
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26baceb-2ad6-4564-8d69-8d0013b00044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Flow 'volume_create_manager' (c87b5514-bcc2-4bf5-81ad-d59b674e0f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:51 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f6292882-755a-4b7a-b10b-67d4e08f0b00 tempest-VolumesCloneNegativeTest-338167669 None] Created volume successfully.
Aug 29 13:19:51 devstack sudo[97762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:19:51 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:51 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.312s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:19:51 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Deleted volume successfully.
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8d8ccfe3-b44e-4e43-a1a6-54cc8e161d95 tempest-TestServerVolumeAttachmentScenario-1105822978 None] Lock "cinder-6268d7ec-6abd-4b63-ac8e-2395077fd639-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:51 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95 1073741824" returned: 0 in 0.646s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:51 devstack sudo[97770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95
Aug 29 13:19:51 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Acquiring lock "cinder-9d67fcf7-ba39-4f69-b922-b0a0c28ec730-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Lock "cinder-9d67fcf7-ba39-4f69-b922-b0a0c28ec730-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Acquiring lock "cinder-quobyte-9d67fcf7-ba39-4f69-b922-b0a0c28ec730" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Lock "cinder-quobyte-9d67fcf7-ba39-4f69-b922-b0a0c28ec730" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0e7855-e472-4e63-9ed3-3cc3490374e1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:52 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95" returned: 0 in 0.447s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9343e5-25ee-4dd7-822b-908cee0092f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d62839-2cc3-4989-a206-475091813d95', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa04d0a9-0a23-4781-996e-d635e291231c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:19:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Volume volume-58d62839-2cc3-4989-a206-475091813d95 (58d62839-2cc3-4989-a206-475091813d95): created successfully
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa04d0a9-0a23-4781-996e-d635e291231c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Flow 'volume_create_manager' (f8d0c21c-fc53-4a61-9d92-41e3bf5df7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:19:52 devstack sudo[97773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730
Aug 29 13:19:52 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:52 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-de514d33-d515-40e9-91ee-5220fc5c7dd1 tempest-VolumesExtendTest-1311793697 None] Created volume successfully.
Aug 29 13:19:52 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730" returned: 0 in 0.414s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:52 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730
Aug 29 13:19:52 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:52 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d67fcf7-ba39-4f69-b922-b0a0c28ec730" returned: 0 in 0.302s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Lock "cinder-quobyte-9d67fcf7-ba39-4f69-b922-b0a0c28ec730" released by "delete_volume" :: held 0.770s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Created reservations ['a4c607dc-6e89-4c5b-8694-3cdd103523ec', '74b378f0-2595-47c1-b907-d04fe944a7b2', 'be8ec928-4bf7-45ec-b7d8-c41abe1a153f', '54ffa8ec-c31e-4080-b232-2fb2f1076eb6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:53 devstack sudo[97782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:19:53 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Creating offline snapshot 527f177e-f460-4776-9cc4-4e526f10b7ad of volume 58d62839-2cc3-4989-a206-475091813d95 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a041df-cdbd-40a9-8e60-27de71d03e9e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:53 devstack sudo[97784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95
Aug 29 13:19:53 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:53 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.517s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:19:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Deleted volume successfully.
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-27d37cdc-7e63-4dd0-8070-f8ea945abb44 tempest-VolumesCloneNegativeTest-338167669 None] Lock "cinder-9d67fcf7-ba39-4f69-b922-b0a0c28ec730-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:19:53 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95" returned: 0 in 0.482s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:53 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad 1G
Aug 29 13:19:53 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:54 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad 1G" returned: 0 in 0.655s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d62839-2cc3-4989-a206-475091813d95 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:19:54 devstack sudo[97796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d62839-2cc3-4989-a206-475091813d95 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad
Aug 29 13:19:54 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:54 devstack sudo[97798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:19:54 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:54 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.315s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:19:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:19:55 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d62839-2cc3-4989-a206-475091813d95 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad" returned: 0 in 0.678s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:55 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad is being set with open permissions: ugo+rw
Aug 29 13:19:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:55 devstack sudo[97804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad
Aug 29 13:19:55 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:55 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad" returned: 0 in 0.328s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:55 devstack sudo[97807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.info
Aug 29 13:19:55 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:56 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.info" returned: 0 in 0.445s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:56 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.info is being set with open permissions: ugo+rw
Aug 29 13:19:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:56 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.info
Aug 29 13:19:56 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:56 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.info" returned: 0 in 0.309s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-157b50d5-2a4e-481b-b146-ef5d22696872 tempest-VolumesExtendTest-1311793697 None] Create snapshot completed successfully
Aug 29 13:19:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c9be18e6-e7e7-413d-8068-03994da71bb5 tempest-VolumesExtendTest-1311793697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:19:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c9be18e6-e7e7-413d-8068-03994da71bb5 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:19:56 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ae3b76-b531-4536-a410-bbd6f4ccd3e4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c9be18e6-e7e7-413d-8068-03994da71bb5 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:56 devstack sudo[97813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95
Aug 29 13:19:56 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:57 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c9be18e6-e7e7-413d-8068-03994da71bb5 tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95" returned: 0 in 0.598s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c9be18e6-e7e7-413d-8068-03994da71bb5 tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad 2G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c9be18e6-e7e7-413d-8068-03994da71bb5 tempest-VolumesExtendTest-1311793697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad 2G" returned: 0 in 0.125s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c9be18e6-e7e7-413d-8068-03994da71bb5 tempest-VolumesExtendTest-1311793697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.769s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:19:57 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c9be18e6-e7e7-413d-8068-03994da71bb5 tempest-VolumesExtendTest-1311793697 None] Extend volume completed successfully.
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Acquiring lock "cinder-527f177e-f460-4776-9cc4-4e526f10b7ad-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Lock "cinder-527f177e-f460-4776-9cc4-4e526f10b7ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Acquiring lock "cinder-quobyte-58d62839-2cc3-4989-a206-475091813d95" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Lock "cinder-quobyte-58d62839-2cc3-4989-a206-475091813d95" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Acquiring lock "cinder-quobyte-527f177e-f460-4776-9cc4-4e526f10b7ad" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Lock "cinder-quobyte-527f177e-f460-4776-9cc4-4e526f10b7ad" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Deleting offline snapshot 527f177e-f460-4776-9cc4-4e526f10b7ad of volume 58d62839-2cc3-4989-a206-475091813d95 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] snapshot_file for this snap is: volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f291f6bb-5be2-4f39-aa17-c5c1efa31cce]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:58 devstack sudo[97821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad
Aug 29 13:19:58 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:58 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad" returned: 0 in 0.501s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d62839-2cc3-4989-a206-475091813d95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c18441-7af6-4c35-95ef-a9d77a016525]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:19:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:58 devstack sudo[97827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95
Aug 29 13:19:58 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:59 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95" returned: 0 in 0.462s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:59 devstack sudo[97832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad
Aug 29 13:19:59 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:19:59 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root
Aug 29 13:19:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad" returned: 0 in 0.517s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:19:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:19:59 devstack sudo[97838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad
Aug 29 13:19:59 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:00 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95.527f177e-f460-4776-9cc4-4e526f10b7ad" returned: 0 in 0.340s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Lock "cinder-quobyte-527f177e-f460-4776-9cc4-4e526f10b7ad" released by "_delete_snapshot" :: held 2.004s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Lock "cinder-quobyte-58d62839-2cc3-4989-a206-475091813d95" released by "delete_snapshot" :: held 2.031s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:00 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Created reservations ['87118164-3e34-4e14-8044-2437a61dfaa1', 'ff52c347-53f4-4053-b9e7-bf2d2b4a7a8b', '9138bb33-d86a-45f3-984b-a848ab62c190', '942d7fb8-2f52-4c44-9f88-42b9411f2774'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Delete snapshot completed successfully.
Aug 29 13:20:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-abe659c3-b737-42f4-906e-3f6b5f51d66a tempest-VolumesExtendTest-1311793697 None] Lock "cinder-527f177e-f460-4776-9cc4-4e526f10b7ad-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Flow 'volume_create_manager' (40edb50d-de1e-454d-acdd-227177be4a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487eb3f9-457b-4c8c-b9c2-8f99427ebd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487eb3f9-457b-4c8c-b9c2-8f99427ebd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1333260515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c250f0e93e4fc59b503c3cb4249c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:01Z,use_quota=True,user_id='8b49a8d413d84a75a1e435b523c3b8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4263b00-db78-48f1-bb96-678b8136caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4263b00-db78-48f1-bb96-678b8136caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52547f58-da78-45bb-97b8-e918e1a0297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52547f58-da78-45bb-97b8-e918e1a0297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d', 'volume_name': 'volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d', 'volume_size': 2}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b063bd0c-eab7-461a-9843-5a218f0f47d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b063bd0c-eab7-461a-9843-5a218f0f47d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8d096f-2f20-43fd-9ee7-a5d6e59b7645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:01 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Volume 8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d', 'volume_size': 2}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1333260515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c250f0e93e4fc59b503c3cb4249c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:01Z,use_quota=True,user_id='8b49a8d413d84a75a1e435b523c3b8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Creating volume 8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:01 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d 2147483648 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:01 devstack sudo[97860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d 2147483648
Aug 29 13:20:01 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Acquiring lock "cinder-58d62839-2cc3-4989-a206-475091813d95-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Lock "cinder-58d62839-2cc3-4989-a206-475091813d95-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Acquiring lock "cinder-quobyte-58d62839-2cc3-4989-a206-475091813d95" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Lock "cinder-quobyte-58d62839-2cc3-4989-a206-475091813d95" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb26388e-b49d-4609-bf0f-1f620b2dfc89]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:01 devstack sudo[97866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95
Aug 29 13:20:01 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:01 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d 2147483648" returned: 0 in 0.599s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:01 devstack sudo[97868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d
Aug 29 13:20:01 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:01 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95" returned: 0 in 0.431s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:02 devstack sudo[97873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95
Aug 29 13:20:02 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:02 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8d096f-2f20-43fd-9ee7-a5d6e59b7645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d', 'volume_size': 2}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf1cf5b-1581-464a-8fc3-b512b1c3113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:02 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Volume volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d (8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d): created successfully
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf1cf5b-1581-464a-8fc3-b512b1c3113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Flow 'volume_create_manager' (40edb50d-de1e-454d-acdd-227177be4a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-dc14a58a-d1b3-4f83-865b-b3135f92b5a1 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Created volume successfully.
Aug 29 13:20:02 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-58d62839-2cc3-4989-a206-475091813d95" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Lock "cinder-quobyte-58d62839-2cc3-4989-a206-475091813d95" released by "delete_volume" :: held 0.747s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Created reservations ['17e89e93-dd05-483e-8a27-49ffc693de45', '2d94ebb9-ef0d-4afc-acbd-5e14910c8a28', 'e1edc048-f209-4cf4-8edc-6e5159dd52f4', 'fe37daa1-34d7-4698-9c9a-1b67ce1e7a66'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:02 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:02 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:02 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Deleted volume successfully.
Aug 29 13:20:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-972045b2-cd67-4688-ac15-2a88b9f452fb tempest-VolumesExtendTest-1311793697 None] Lock "cinder-58d62839-2cc3-4989-a206-475091813d95-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Creating offline snapshot 45f20eeb-58f4-4a2b-aa4d-378687575a99 of volume 8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:20:03 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3733ea78-b10f-4d6c-812b-2caecbab8cb2]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:03 devstack sudo[97881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d
Aug 29 13:20:03 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:03 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" returned: 0 in 0.389s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 2G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:03 devstack sudo[97886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 2G
Aug 29 13:20:03 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:04 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 2G" returned: 0 in 0.495s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:04 devstack sudo[97892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99
Aug 29 13:20:04 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:04 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99" returned: 0 in 0.337s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:04 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 is being set with open permissions: ugo+rw
Aug 29 13:20:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:04 devstack sudo[97899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99
Aug 29 13:20:04 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:04 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99" returned: 0 in 0.274s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:04 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.info
Aug 29 13:20:04 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:05 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.info" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:05 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.info is being set with open permissions: ugo+rw
Aug 29 13:20:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:05 devstack sudo[97905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.info
Aug 29 13:20:05 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:05 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.info" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-597a6040-4e03-436e-b70c-ee872625ae7b tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Create snapshot completed successfully
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (da69c593-d6da-437d-84e3-54bef316049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fba505-b23b-42ff-8702-1f18261ef137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fba505-b23b-42ff-8702-1f18261ef137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1609206768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130e2c93-9342-4f53-96cb-50d175961394,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:06Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a748e8-5de8-45df-aa79-0705ffd14501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a748e8-5de8-45df-aa79-0705ffd14501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc03e54a-375e-4d7a-a595-e54528ee5553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc03e54a-375e-4d7a-a595-e54528ee5553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130e2c93-9342-4f53-96cb-50d175961394', 'volume_name': 'volume-130e2c93-9342-4f53-96cb-50d175961394', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739c168c-9ffb-48c0-ae52-8bef277e3042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739c168c-9ffb-48c0-ae52-8bef277e3042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa7a94e-14fb-4fd6-a6c2-5e672a975d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:06 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Volume 130e2c93-9342-4f53-96cb-50d175961394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130e2c93-9342-4f53-96cb-50d175961394', 'volume_size': 1}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1609206768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130e2c93-9342-4f53-96cb-50d175961394,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:06Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Creating volume 130e2c93-9342-4f53-96cb-50d175961394 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:06 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:06 devstack sudo[97908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394 1073741824
Aug 29 13:20:06 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Acquiring lock "cinder-45f20eeb-58f4-4a2b-aa4d-378687575a99-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-45f20eeb-58f4-4a2b-aa4d-378687575a99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Acquiring lock "cinder-quobyte-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-quobyte-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Acquiring lock "cinder-quobyte-45f20eeb-58f4-4a2b-aa4d-378687575a99" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-quobyte-45f20eeb-58f4-4a2b-aa4d-378687575a99" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Deleting offline snapshot 45f20eeb-58f4-4a2b-aa4d-378687575a99 of volume 8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] snapshot_file for this snap is: volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd3753a-b6a0-4b69-a3fc-ced5795d8165]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:06 devstack sudo[97914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99
Aug 29 13:20:06 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:06 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394 1073741824" returned: 0 in 0.513s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:06 devstack sudo[97916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394
Aug 29 13:20:06 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:07 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99" returned: 0 in 0.539s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:20:07 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394" returned: 0 in 0.362s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa7a94e-14fb-4fd6-a6c2-5e672a975d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130e2c93-9342-4f53-96cb-50d175961394', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2e07ab-4697-4e98-8fc8-dc2aa142d647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bd2f9e-8a03-4722-b5a0-cb74c9578996]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:07 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Volume volume-130e2c93-9342-4f53-96cb-50d175961394 (130e2c93-9342-4f53-96cb-50d175961394): created successfully
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2e07ab-4697-4e98-8fc8-dc2aa142d647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (da69c593-d6da-437d-84e3-54bef316049e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f4364ec9-9b08-412a-ba6c-7e89a79306b6 tempest-VolumesGetTest-951104990 None] Created volume successfully.
Aug 29 13:20:07 devstack sudo[97922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d
Aug 29 13:20:07 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:07 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" returned: 0 in 0.472s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:07 devstack sudo[97927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99
Aug 29 13:20:07 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:08 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99" returned: 0 in 0.386s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:08 devstack sudo[97932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99
Aug 29 13:20:08 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:08 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d.45f20eeb-58f4-4a2b-aa4d-378687575a99" returned: 0 in 0.338s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-quobyte-45f20eeb-58f4-4a2b-aa4d-378687575a99" released by "_delete_snapshot" :: held 1.886s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-quobyte-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" released by "delete_snapshot" :: held 1.922s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:08 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Created reservations ['f8753e49-c9d9-4fdb-aac9-ce97937d45c7', '0fd16010-3325-4136-8798-e3d676eb741f', '2643f8fe-67b1-4046-8369-96927b13537e', '726fb4d8-8adb-4717-b80a-3ac56aa08271'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:08 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Delete snapshot completed successfully.
Aug 29 13:20:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-480789a1-6a3a-4826-86ed-35cfe6c5a9aa tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-45f20eeb-58f4-4a2b-aa4d-378687575a99-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Acquiring lock "cinder-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Acquiring lock "cinder-quobyte-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-quobyte-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5674bcc-8f91-4625-9057-4acc68d5af7a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:09 devstack sudo[97935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d
Aug 29 13:20:09 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (a6e73094-41a6-451a-8c10-1ff3f2637d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b456de25-18a1-43fa-a39b-13f6dff96630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b456de25-18a1-43fa-a39b-13f6dff96630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1268987974',display_name='tempest-VolumesGetTest-Volume-1918311227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbf95eb-5ac9-48e1-950c-c99bca1a6452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:09Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca7e103-c4c4-44a3-b9a0-082eecf55688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca7e103-c4c4-44a3-b9a0-082eecf55688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fb3e99-1e24-44b1-87fb-172f73bb5af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fb3e99-1e24-44b1-87fb-172f73bb5af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfbf95eb-5ac9-48e1-950c-c99bca1a6452', 'volume_name': 'volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1846522-9584-4de0-bbe2-7ed4e8040105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1846522-9584-4de0-bbe2-7ed4e8040105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accfba67-6089-4e4b-ad66-8998a079765f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:09 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Volume bfbf95eb-5ac9-48e1-950c-c99bca1a6452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452', 'volume_size': 1}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1268987974',display_name='tempest-VolumesGetTest-Volume-1918311227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbf95eb-5ac9-48e1-950c-c99bca1a6452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:09Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Creating volume bfbf95eb-5ac9-48e1-950c-c99bca1a6452 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:09 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:09 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" returned: 0 in 0.446s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:09 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452 1073741824
Aug 29 13:20:09 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:09 devstack sudo[97941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d
Aug 29 13:20:09 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:09 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" returned: 0 in 0.385s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-quobyte-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d" released by "delete_volume" :: held 0.904s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Created reservations ['533e6998-3088-4697-bff9-d67f2adff195', '6216c995-9ba6-44cb-b6da-6f10430a04e5', 'f3f95a7f-e8f7-48c2-81ac-a688c5852db4', '389e260b-bb2a-499f-86dd-d5642aafee74'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:10 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452 1073741824" returned: 0 in 0.601s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:10 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:10 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:10 devstack sudo[97951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452
Aug 29 13:20:10 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:10 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.281s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Deleted volume successfully.
Aug 29 13:20:10 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452" returned: 0 in 0.273s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accfba67-6089-4e4b-ad66-8998a079765f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f207257-697f-4957-888c-92c996acc295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6442ad42-d240-4ce2-aaae-8b00a98a4314 tempest-VolumesSnapshotNegativeTestJSON-186394661 None] Lock "cinder-8b2ef92d-2dae-4d70-93c2-1f3c5ff9c61d-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:10 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Volume volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452 (bfbf95eb-5ac9-48e1-950c-c99bca1a6452): created successfully
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f207257-697f-4957-888c-92c996acc295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (a6e73094-41a6-451a-8c10-1ff3f2637d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3e62af13-1571-4b6f-9cda-791fe1d591f1 tempest-VolumesGetTest-951104990 None] Created volume successfully.
Aug 29 13:20:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-bfbf95eb-5ac9-48e1-950c-c99bca1a6452-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Lock "cinder-bfbf95eb-5ac9-48e1-950c-c99bca1a6452-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-quobyte-bfbf95eb-5ac9-48e1-950c-c99bca1a6452" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-bfbf95eb-5ac9-48e1-950c-c99bca1a6452" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[418aedb3-3e94-4fba-9134-809413900403]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:12 devstack sudo[97957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452
Aug 29 13:20:12 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Flow 'volume_create_manager' (e053cd39-45f5-48d6-8c5e-23453e3346d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d861a75-3832-456c-b6d5-8e6284c5b4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d861a75-3832-456c-b6d5-8e6284c5b4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2125607993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e859a7-e232-43ba-8925-84d0db6947b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2534b2fd9940f1a22c44166e3635e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:12Z,use_quota=True,user_id='572cccdc39e7472abb30ac2a25ee6e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a978ff4-ec91-4f80-b402-d7a20f01421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a978ff4-ec91-4f80-b402-d7a20f01421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e05b326-bf14-41a4-8ef7-c9764ff5dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e05b326-bf14-41a4-8ef7-c9764ff5dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e859a7-e232-43ba-8925-84d0db6947b7', 'volume_name': 'volume-d6e859a7-e232-43ba-8925-84d0db6947b7', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337491e0-cdce-4c4b-ad08-b0e70d7f5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337491e0-cdce-4c4b-ad08-b0e70d7f5b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca80c81b-0938-4016-b8e9-c1f927dacb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:12 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Volume d6e859a7-e232-43ba-8925-84d0db6947b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e859a7-e232-43ba-8925-84d0db6947b7', 'volume_size': 1}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2125607993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e859a7-e232-43ba-8925-84d0db6947b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2534b2fd9940f1a22c44166e3635e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:12Z,use_quota=True,user_id='572cccdc39e7472abb30ac2a25ee6e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Creating volume d6e859a7-e232-43ba-8925-84d0db6947b7 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:12 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:12 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7 1073741824
Aug 29 13:20:12 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:12 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452" returned: 0 in 0.624s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:12 devstack sudo[97964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452
Aug 29 13:20:12 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:12 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bfbf95eb-5ac9-48e1-950c-c99bca1a6452" returned: 0 in 0.414s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-bfbf95eb-5ac9-48e1-950c-c99bca1a6452" released by "delete_volume" :: held 1.095s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:12 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Created reservations ['d9d1900f-dde1-45fa-8b93-d883d74bad19', 'f3011f8c-ce95-45e7-bfbc-b274392d2f78', '99488c6f-6ff6-4702-b25c-6d48d8db4072', '48a82784-614e-465b-9393-32241f919fd2'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:13 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7 1073741824" returned: 0 in 0.790s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:13 devstack sudo[97971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:13 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:13 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7
Aug 29 13:20:13 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:13 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.364s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:13 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Deleted volume successfully.
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7" returned: 0 in 0.353s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca80c81b-0938-4016-b8e9-c1f927dacb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e859a7-e232-43ba-8925-84d0db6947b7', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423c44c7-4008-4378-b716-4d05e28aef40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-581d2014-4e09-4b1d-9445-bcb22b94f7b5 tempest-VolumesGetTest-951104990 None] Lock "cinder-bfbf95eb-5ac9-48e1-950c-c99bca1a6452-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:13 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Volume volume-d6e859a7-e232-43ba-8925-84d0db6947b7 (d6e859a7-e232-43ba-8925-84d0db6947b7): created successfully
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423c44c7-4008-4378-b716-4d05e28aef40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Flow 'volume_create_manager' (e053cd39-45f5-48d6-8c5e-23453e3346d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8f350982-127c-4095-a1fc-0b2be1d960e1 tempest-AttachVolumeTestJSON-2067344242 None] Created volume successfully.
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-130e2c93-9342-4f53-96cb-50d175961394-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Lock "cinder-130e2c93-9342-4f53-96cb-50d175961394-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=108,cinder:UPDATE=117,cinder:DELETE=8,cinder:INSERT=33 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=124,cinder:INSERT=34,cinder:SELECT=103,cinder:DELETE=11 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-quobyte-130e2c93-9342-4f53-96cb-50d175961394" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-130e2c93-9342-4f53-96cb-50d175961394" acquired by "delete_volume" :: waited 0.040s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dd3274-ebbb-4ced-a84d-dd6498329a74]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:14 devstack sudo[97977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394
Aug 29 13:20:14 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:14 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394" returned: 0 in 0.434s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:14 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394
Aug 29 13:20:14 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:15 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-130e2c93-9342-4f53-96cb-50d175961394" returned: 0 in 0.435s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-130e2c93-9342-4f53-96cb-50d175961394" released by "delete_volume" :: held 0.927s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Created reservations ['ad5e7d3e-b552-4d05-9637-3db22091eec6', 'e5d96fc7-df30-4b6d-b433-1c4e9b48a863', '204d3270-4e35-4fbf-a50c-c9f5d7dad006', 'bdf42cff-f67a-471a-8a1a-2a3ff0f04e13'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-9fc97173-3131-44cb-aeaf-2bc0728c9e73 req-b58a97d5-2898-4e31-b417-0f472ced0a5b tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-9fc97173-3131-44cb-aeaf-2bc0728c9e73 req-b58a97d5-2898-4e31-b417-0f472ced0a5b tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-9fc97173-3131-44cb-aeaf-2bc0728c9e73 req-b58a97d5-2898-4e31-b417-0f472ced0a5b tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:15 devstack sudo[97996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:15 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-9fc97173-3131-44cb-aeaf-2bc0728c9e73 req-b58a97d5-2898-4e31-b417-0f472ced0a5b tempest-AttachVolumeTestJSON-2067344242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-d6e859a7-e232-43ba-8925-84d0db6947b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '402a6e84-cc1c-497f-a8ed-f280b46faf6e', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:20:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-9fc97173-3131-44cb-aeaf-2bc0728c9e73 req-b58a97d5-2898-4e31-b417-0f472ced0a5b tempest-AttachVolumeTestJSON-2067344242 None] attachment_update completed successfully.
Aug 29 13:20:15 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.426s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Deleted volume successfully.
Aug 29 13:20:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f36902ba-6226-4e69-a5ac-f48e6ef8089f tempest-VolumesGetTest-951104990 None] Lock "cinder-130e2c93-9342-4f53-96cb-50d175961394-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (0375ef77-578f-4f4e-a6c3-32fd74ea961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2ffa27-a9dd-435b-b6fc-a59e94804ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2ffa27-a9dd-435b-b6fc-a59e94804ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-330268891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934d8dbd-1c07-4917-a313-d60fe76b1af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:17Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580bf105-c4e9-4c97-8739-2f6d915eeb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580bf105-c4e9-4c97-8739-2f6d915eeb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36400e65-ec16-455b-9525-67fdf507e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36400e65-ec16-455b-9525-67fdf507e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934d8dbd-1c07-4917-a313-d60fe76b1af9', 'volume_name': 'volume-934d8dbd-1c07-4917-a313-d60fe76b1af9', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000d9209-0131-4161-83ac-2e1a9e3f3a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000d9209-0131-4161-83ac-2e1a9e3f3a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad90a4b9-7c76-4b21-8444-fab8183bc916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:17 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Volume 934d8dbd-1c07-4917-a313-d60fe76b1af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934d8dbd-1c07-4917-a313-d60fe76b1af9', 'volume_size': 1}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-330268891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934d8dbd-1c07-4917-a313-d60fe76b1af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:17Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Creating volume 934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:17 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:17 devstack sudo[98382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 1073741824
Aug 29 13:20:17 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:17 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 1073741824" returned: 0 in 0.660s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:17 devstack sudo[98388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9
Aug 29 13:20:17 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:18 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9" returned: 0 in 0.370s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad90a4b9-7c76-4b21-8444-fab8183bc916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934d8dbd-1c07-4917-a313-d60fe76b1af9', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942fe11d-a2fc-4331-8813-ae16b52445f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Volume volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 (934d8dbd-1c07-4917-a313-d60fe76b1af9): created successfully
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942fe11d-a2fc-4331-8813-ae16b52445f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (0375ef77-578f-4f4e-a6c3-32fd74ea961b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Flow 'volume_create_manager' (f1dc623a-2967-402b-8ce6-661f9699a5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8f99bd-3f9a-46b0-ac50-1dff01f568d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8f99bd-3f9a-46b0-ac50-1dff01f568d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-278318558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2c4fe1-e604-4e2c-bba3-b9378f2031be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2534b2fd9940f1a22c44166e3635e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:18Z,use_quota=True,user_id='572cccdc39e7472abb30ac2a25ee6e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07661249-de6c-45b9-906e-7f2482f82a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07661249-de6c-45b9-906e-7f2482f82a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c68f30d-8680-4482-90c7-0137091acbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c68f30d-8680-4482-90c7-0137091acbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2c4fe1-e604-4e2c-bba3-b9378f2031be', 'volume_name': 'volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13923f8c-68fa-43be-bb8b-5a9bdaf6402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13923f8c-68fa-43be-bb8b-5a9bdaf6402c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1574b2a1-e89d-4fcb-aa42-2a2981f0d0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Volume 8b2c4fe1-e604-4e2c-bba3-b9378f2031be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be', 'volume_size': 1}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-278318558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2c4fe1-e604-4e2c-bba3-b9378f2031be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2534b2fd9940f1a22c44166e3635e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:18Z,use_quota=True,user_id='572cccdc39e7472abb30ac2a25ee6e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Creating volume 8b2c4fe1-e604-4e2c-bba3-b9378f2031be {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:18 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ef09a751-fedf-4178-b161-1a6234c8a45c tempest-VolumesGetTest-951104990 None] Created volume successfully.
Aug 29 13:20:18 devstack sudo[98391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be 1073741824
Aug 29 13:20:18 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:19 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be 1073741824" returned: 0 in 0.650s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:19 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be
Aug 29 13:20:19 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:19 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be" returned: 0 in 0.406s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1574b2a1-e89d-4fcb-aa42-2a2981f0d0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ea96eb-3758-412f-bb88-7fd3da675e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:19 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Volume volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be (8b2c4fe1-e604-4e2c-bba3-b9378f2031be): created successfully
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ea96eb-3758-412f-bb88-7fd3da675e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Flow 'volume_create_manager' (f1dc623a-2967-402b-8ce6-661f9699a5a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:19 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-377756c6-5862-48e2-ba76-71001ae77887 tempest-AttachVolumeTestJSON-2067344242 None] Created volume successfully.
Aug 29 13:20:19 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (50938ba4-af69-4251-abd7-758c9bbc7171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64caf9ec-aa46-441c-893a-11437fa09f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64caf9ec-aa46-441c-893a-11437fa09f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-531666971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14040bd-e9af-4177-85c5-847a8a1b54ac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=934d8dbd-1c07-4917-a313-d60fe76b1af9,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:20Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4e29f9-7073-403d-80ea-4556e0f3c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4e29f9-7073-403d-80ea-4556e0f3c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8934ba87-3a25-4879-9b84-8f784cd9251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8934ba87-3a25-4879-9b84-8f784cd9251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a14040bd-e9af-4177-85c5-847a8a1b54ac', 'volume_name': 'volume-a14040bd-e9af-4177-85c5-847a8a1b54ac', 'volume_size': 1, 'source_volid': '934d8dbd-1c07-4917-a313-d60fe76b1af9', 'source_volstatus': 'available'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1814105-a66a-4360-aae1-d40a45ae05bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1814105-a66a-4360-aae1-d40a45ae05bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21989cd5-2e74-431c-9ac6-c957f22fea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:20 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Volume a14040bd-e9af-4177-85c5-847a8a1b54ac: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a14040bd-e9af-4177-85c5-847a8a1b54ac', 'volume_size': 1, 'source_volid': '934d8dbd-1c07-4917-a313-d60fe76b1af9', 'source_volstatus': 'available'}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:20 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Cloning volume 934d8dbd-1c07-4917-a313-d60fe76b1af9 to volume a14040bd-e9af-4177-85c5-847a8a1b54ac
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Creating offline snapshot f76e1994-a4c7-4b16-adfb-a0591aeab689 of volume 934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20378fc-7047-4bfc-891f-de10a56652ee]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:20 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9
Aug 29 13:20:20 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:20 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9" returned: 0 in 0.492s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:20 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 1G
Aug 29 13:20:20 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:21 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 1G" returned: 0 in 0.597s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:21 devstack sudo[98423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689
Aug 29 13:20:21 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-b41a4e1e-6401-49fb-af37-5f8529934be6 req-045e9c20-927d-4192-9e73-a5347b7d2412 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:21 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689" returned: 0 in 0.344s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:21 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 is being set with open permissions: ugo+rw
Aug 29 13:20:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:21 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689
Aug 29 13:20:21 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:22 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689" returned: 0 in 0.333s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:22 devstack sudo[98431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.info
Aug 29 13:20:22 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:22 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.info" returned: 0 in 0.295s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:22 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.info is being set with open permissions: ugo+rw
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:22 devstack sudo[98434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.info
Aug 29 13:20:22 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:22 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.info" returned: 0 in 0.281s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-quobyte-a14040bd-e9af-4177-85c5-847a8a1b54ac" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-a14040bd-e9af-4177-85c5-847a8a1b54ac" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] snapshot: f76e1994-a4c7-4b16-adfb-a0591aeab689, volume: a14040bd-e9af-4177-85c5-847a8a1b54ac,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[77415c55-d015-4999-bd6f-9d876749b211]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:22 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689
Aug 29 13:20:22 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:23 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689" returned: 0 in 0.559s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934d8dbd-1c07-4917-a313-d60fe76b1af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:20:23 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a20bec-e195-4623-81e2-0a7c3c42663d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:23 devstack sudo[98480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9
Aug 29 13:20:23 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:23 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9" returned: 0 in 0.361s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:20:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:20:23 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:20:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:23 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac
Aug 29 13:20:23 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:29 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac" returned: 0 in 6.018s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:29 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:20:29 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Converted 1024.00 MB image at 170.11 MB/s
Aug 29 13:20:29 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac is being set with open permissions: ugo+rw
Aug 29 13:20:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:29 devstack sudo[98500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac
Aug 29 13:20:29 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:29 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac" returned: 0 in 0.307s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-a14040bd-e9af-4177-85c5-847a8a1b54ac" released by "_copy_volume_from_snapshot" :: held 7.330s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-quobyte-f76e1994-a4c7-4b16-adfb-a0591aeab689" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-f76e1994-a4c7-4b16-adfb-a0591aeab689" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Deleting offline snapshot f76e1994-a4c7-4b16-adfb-a0591aeab689 of volume 934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] snapshot_file for this snap is: volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[96429a15-746e-46e0-9c48-4914828ae881]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:30 devstack sudo[98503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689
Aug 29 13:20:30 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:30 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689" returned: 0 in 0.444s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934d8dbd-1c07-4917-a313-d60fe76b1af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[186182c1-2171-41ec-aa92-1f2f19af497c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:30 devstack sudo[98508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9
Aug 29 13:20:30 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:31 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9" returned: 0 in 0.667s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:31 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689
Aug 29 13:20:31 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:31 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689" returned: 0 in 0.396s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:31 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689
Aug 29 13:20:31 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:31 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9.f76e1994-a4c7-4b16-adfb-a0591aeab689" returned: 0 in 0.272s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-f76e1994-a4c7-4b16-adfb-a0591aeab689" released by "_delete_snapshot" :: held 1.908s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.809s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-b41a4e1e-6401-49fb-af37-5f8529934be6 req-045e9c20-927d-4192-9e73-a5347b7d2412 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.545s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21989cd5-2e74-431c-9ac6-c957f22fea40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14040bd-e9af-4177-85c5-847a8a1b54ac', 'volume_size': 1, 'source_volid': '934d8dbd-1c07-4917-a313-d60fe76b1af9', 'source_volstatus': 'available'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ea1af4-84bc-41f3-81b8-e34ef51f3ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-b41a4e1e-6401-49fb-af37-5f8529934be6 req-045e9c20-927d-4192-9e73-a5347b7d2412 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:32 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Volume volume-a14040bd-e9af-4177-85c5-847a8a1b54ac (a14040bd-e9af-4177-85c5-847a8a1b54ac): created successfully
Aug 29 13:20:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ea1af4-84bc-41f3-81b8-e34ef51f3ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (50938ba4-af69-4251-abd7-758c9bbc7171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-b41a4e1e-6401-49fb-af37-5f8529934be6 req-045e9c20-927d-4192-9e73-a5347b7d2412 tempest-AttachVolumeTestJSON-2067344242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10063565-ab5e-4cfc-924d-d6f3e99a5784', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:20:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-da6c023d-db60-4962-a0a2-c4f925a07b4a tempest-VolumesGetTest-951104990 None] Created volume successfully.
Aug 29 13:20:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-b41a4e1e-6401-49fb-af37-5f8529934be6 req-045e9c20-927d-4192-9e73-a5347b7d2412 tempest-AttachVolumeTestJSON-2067344242 None] attachment_update completed successfully.
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (5bb68747-f0c9-4fc4-a39e-50f2a4ed657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd165db-0d95-418e-8d38-a59667424a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd165db-0d95-418e-8d38-a59667424a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-272414383',display_name='tempest-VolumesGetTest-Volume-924234822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d854e953-f5da-4cac-ade5-0702e6fd354a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:33Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1febfdf5-4735-44a1-842b-da6bad95a4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1febfdf5-4735-44a1-842b-da6bad95a4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37e4f4e-d859-4ba8-afb4-b1ee554842e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37e4f4e-d859-4ba8-afb4-b1ee554842e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd854e953-f5da-4cac-ade5-0702e6fd354a', 'volume_name': 'volume-d854e953-f5da-4cac-ade5-0702e6fd354a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fa773a-5fd8-4dcc-af65-b65683c5e1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fa773a-5fd8-4dcc-af65-b65683c5e1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a78cdaa-038e-4010-a333-64b4610bb6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:33 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Volume d854e953-f5da-4cac-ade5-0702e6fd354a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d854e953-f5da-4cac-ade5-0702e6fd354a', 'volume_size': 1}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-272414383',display_name='tempest-VolumesGetTest-Volume-924234822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d854e953-f5da-4cac-ade5-0702e6fd354a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:33Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Creating volume d854e953-f5da-4cac-ade5-0702e6fd354a {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:33 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:33 devstack sudo[98535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a 1073741824
Aug 29 13:20:33 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:34 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a 1073741824" returned: 0 in 0.559s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:34 devstack sudo[98543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a
Aug 29 13:20:34 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:34 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a" returned: 0 in 0.450s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a78cdaa-038e-4010-a333-64b4610bb6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d854e953-f5da-4cac-ade5-0702e6fd354a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b3da9c-8e57-48bc-891c-a258e5a4a42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:34 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Volume volume-d854e953-f5da-4cac-ade5-0702e6fd354a (d854e953-f5da-4cac-ade5-0702e6fd354a): created successfully
Aug 29 13:20:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b3da9c-8e57-48bc-891c-a258e5a4a42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (5bb68747-f0c9-4fc4-a39e-50f2a4ed657c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-15631af7-2aad-4e87-aace-92a076ccf830 tempest-VolumesGetTest-951104990 None] Created volume successfully.
Aug 29 13:20:35 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-cad4bf20-b3aa-4065-831b-c20b2af709bf req-d566d88b-5b7e-4431-9b1a-797508b1c2d3 tempest-AttachVolumeTestJSON-2067344242 None] Terminate volume connection completed successfully.
Aug 29 13:20:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-cad4bf20-b3aa-4065-831b-c20b2af709bf req-d566d88b-5b7e-4431-9b1a-797508b1c2d3 tempest-AttachVolumeTestJSON-2067344242 None] Deleting attachment 402a6e84-cc1c-497f-a8ed-f280b46faf6e. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:20:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-d854e953-f5da-4cac-ade5-0702e6fd354a-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Lock "cinder-d854e953-f5da-4cac-ade5-0702e6fd354a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-quobyte-d854e953-f5da-4cac-ade5-0702e6fd354a" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-d854e953-f5da-4cac-ade5-0702e6fd354a" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:35 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[195a3663-3fd5-4d75-9fde-1a552750cf93]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:35 devstack sudo[98572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a
Aug 29 13:20:35 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:36 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a" returned: 0 in 0.579s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:36 devstack sudo[98577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a
Aug 29 13:20:36 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:36 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d854e953-f5da-4cac-ade5-0702e6fd354a" returned: 0 in 0.410s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-d854e953-f5da-4cac-ade5-0702e6fd354a" released by "delete_volume" :: held 1.095s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:36 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-db4aa24f-ebdf-4b9b-8426-4addd6119167 req-f2242b8e-a194-40a5-8623-b2768b02edaf tempest-AttachVolumeTestJSON-2067344242 None] Terminate volume connection completed successfully.
Aug 29 13:20:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-db4aa24f-ebdf-4b9b-8426-4addd6119167 req-f2242b8e-a194-40a5-8623-b2768b02edaf tempest-AttachVolumeTestJSON-2067344242 None] Deleting attachment 10063565-ab5e-4cfc-924d-d6f3e99a5784. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:20:36 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Created reservations ['b9cc2af3-7310-427f-a027-e0af2e541c0f', '00ad7534-d880-4f78-a4c1-83e745d84fc9', '60d18df5-ad32-4009-b0cf-63c3150b1a6a', '6e970b6a-1ffa-490d-804a-74fe75c40192'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:37 devstack sudo[98583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:37 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:37 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.313s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:37 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:37 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Deleted volume successfully.
Aug 29 13:20:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-74a4e565-1086-451f-8e51-c326c87ae33f tempest-VolumesGetTest-951104990 None] Lock "cinder-d854e953-f5da-4cac-ade5-0702e6fd354a-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-a14040bd-e9af-4177-85c5-847a8a1b54ac-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Lock "cinder-a14040bd-e9af-4177-85c5-847a8a1b54ac-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-quobyte-a14040bd-e9af-4177-85c5-847a8a1b54ac" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-a14040bd-e9af-4177-85c5-847a8a1b54ac" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[318d1e86-dc80-4e8f-bbd9-33dfb25a87f6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:38 devstack sudo[98586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac
Aug 29 13:20:38 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:39 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac" returned: 0 in 0.776s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:39 devstack sudo[98610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac
Aug 29 13:20:39 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:39 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a14040bd-e9af-4177-85c5-847a8a1b54ac" returned: 0 in 0.474s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Flow 'volume_create_manager' (f83b77d4-3eea-49e9-a19f-0a65ed49c91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d7a689-58be-4955-a02f-83ae7bfcde3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-a14040bd-e9af-4177-85c5-847a8a1b54ac" released by "delete_volume" :: held 1.421s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d7a689-58be-4955-a02f-83ae7bfcde3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-609856542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e56b36-0258-47ed-9265-627189a7fec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa700fabc834eed861b690eda694d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:40Z,use_quota=True,user_id='e47ff6655851427ab1f71b3bfdcd0ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd3946c-cd06-48f3-8890-218af38428c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd3946c-cd06-48f3-8890-218af38428c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02adbf2b-cc6b-4e4c-b20c-e05ba607b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02adbf2b-cc6b-4e4c-b20c-e05ba607b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e56b36-0258-47ed-9265-627189a7fec4', 'volume_name': 'volume-40e56b36-0258-47ed-9265-627189a7fec4', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea96dff0-653f-48d8-9586-cea00d7983e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea96dff0-653f-48d8-9586-cea00d7983e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5721aa1-1034-490c-b4dc-86b081bb0fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:39 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Volume 40e56b36-0258-47ed-9265-627189a7fec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e56b36-0258-47ed-9265-627189a7fec4', 'volume_size': 1}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-609856542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e56b36-0258-47ed-9265-627189a7fec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa700fabc834eed861b690eda694d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:40Z,use_quota=True,user_id='e47ff6655851427ab1f71b3bfdcd0ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Creating volume 40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:39 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:39 devstack sudo[98615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 1073741824
Aug 29 13:20:39 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Created reservations ['88d52266-e145-4898-a7bd-ea9588b4d2e9', '849b3e9b-9593-4fa2-b074-c21963f727f6', '0359e501-348c-484a-b9b3-cd17aa0c7e21', 'c139bacc-8691-4a10-8d16-4b1601f7179b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:40 devstack sudo[98617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:40 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:40 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.351s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Deleted volume successfully.
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3e75a4bc-5181-41b5-b71b-cc579d4bd806 tempest-VolumesGetTest-951104990 None] Lock "cinder-a14040bd-e9af-4177-85c5-847a8a1b54ac-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:40 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 1073741824" returned: 0 in 0.633s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:40 devstack sudo[98631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4
Aug 29 13:20:40 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-934d8dbd-1c07-4917-a313-d60fe76b1af9-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Lock "cinder-934d8dbd-1c07-4917-a313-d60fe76b1af9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-quobyte-934d8dbd-1c07-4917-a313-d60fe76b1af9" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-934d8dbd-1c07-4917-a313-d60fe76b1af9" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9550b6f6-7bd9-4f42-9e7e-2c8a32548788]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:40 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4" returned: 0 in 0.335s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5721aa1-1034-490c-b4dc-86b081bb0fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e56b36-0258-47ed-9265-627189a7fec4', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2848fe0-a89b-48e4-bd3e-54d489592e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:40 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Volume volume-40e56b36-0258-47ed-9265-627189a7fec4 (40e56b36-0258-47ed-9265-627189a7fec4): created successfully
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2848fe0-a89b-48e4-bd3e-54d489592e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Flow 'volume_create_manager' (f83b77d4-3eea-49e9-a19f-0a65ed49c91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-924a8831-2194-4592-82fc-a56b57effdcb tempest-TestStampPattern-1653392327 None] Created volume successfully.
Aug 29 13:20:40 devstack sudo[98633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9
Aug 29 13:20:40 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:41 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9" returned: 0 in 0.521s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:41 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9
Aug 29 13:20:41 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:41 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-934d8dbd-1c07-4917-a313-d60fe76b1af9" returned: 0 in 0.295s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-934d8dbd-1c07-4917-a313-d60fe76b1af9" released by "delete_volume" :: held 0.924s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Created reservations ['05376d74-b8e0-4931-8a1c-ccf83b09a1e0', '986a8d51-d136-43e9-a814-edd075d82965', '5a417f3c-8928-472e-8cc3-17b789e7aa6a', 'c596284d-f0a2-4cf5-9f66-0cfbf012eb69'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:41 devstack sudo[98643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:41 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:42 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.332s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:42 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:42 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Deleted volume successfully.
Aug 29 13:20:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-466376bf-5502-4334-8719-9a6a9ecab343 tempest-VolumesGetTest-951104990 None] Lock "cinder-934d8dbd-1c07-4917-a313-d60fe76b1af9-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:43 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (1a1f2855-7bcb-4f58-8901-121b84e638d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424ac9b1-0efb-44e9-98c5-16904e509730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424ac9b1-0efb-44e9-98c5-16904e509730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2120691518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9d64ed-3048-4533-85ea-69182a3eeb06,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:44Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61648492-57c8-410c-9d4c-7da81e82f056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61648492-57c8-410c-9d4c-7da81e82f056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c8f3fe-e24f-4311-aef0-44ecbc8f77e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:43 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "cinder-8b2c4fe1-e604-4e2c-bba3-b9378f2031be-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-8b2c4fe1-e604-4e2c-bba3-b9378f2031be-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "cinder-quobyte-8b2c4fe1-e604-4e2c-bba3-b9378f2031be" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-quobyte-8b2c4fe1-e604-4e2c-bba3-b9378f2031be" acquired by "delete_volume" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e803fa13-d485-4c7a-8265-13195d6c695e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:44 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be
Aug 29 13:20:44 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c8f3fe-e24f-4311-aef0-44ecbc8f77e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a9d64ed-3048-4533-85ea-69182a3eeb06', 'volume_name': 'volume-7a9d64ed-3048-4533-85ea-69182a3eeb06', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b616498200>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06e9cc1-7a95-4cdd-880c-d863b34fd1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06e9cc1-7a95-4cdd-880c-d863b34fd1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2243c3-bad4-4a82-b209-137c454e4f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:44 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Volume 7a9d64ed-3048-4533-85ea-69182a3eeb06: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a9d64ed-3048-4533-85ea-69182a3eeb06', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b616498200>}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Trying to clone 7a9d64ed-3048-4533-85ea-69182a3eeb06 from image 9ccc8465-2a9b-49d5-8097-23b2336c201f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:20:44 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be" returned: 0 in 0.507s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:44 devstack sudo[98662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be
Aug 29 13:20:44 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:45 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8b2c4fe1-e604-4e2c-bba3-b9378f2031be" returned: 0 in 0.368s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-quobyte-8b2c4fe1-e604-4e2c-bba3-b9378f2031be" released by "delete_volume" :: held 0.984s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:20:45 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Image download 20.69 MB at 20.69 MB/s
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Created reservations ['d00c5805-86a8-412e-80c7-942e19ddd50a', '83939a24-d23a-42e3-9a39-26145c3de187', '44a2d6d6-64c2-4534-8e5c-4a8636fffda1', '6aaacf6a-12e0-4471-86d4-ddb8ce974be7'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ef1b9-a37c-49f2-9080-f086d6a7072f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:45 devstack sudo[98678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:45 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:45 devstack sudo[98677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD
Aug 29 13:20:45 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:45 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.279s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Deleted volume successfully.
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f8d652b-6f4d-45d1-b353-9f0f04007ca8 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-8b2c4fe1-e604-4e2c-bba3-b9378f2031be-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:45 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:45 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f is fetched for user fad7cb0d44fb41fc9f1d5f8356abc919. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6530d45-14e6-44da-afdb-0e766a974761]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:46 devstack sudo[98685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD
Aug 29 13:20:46 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "cinder-d6e859a7-e232-43ba-8925-84d0db6947b7-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-d6e859a7-e232-43ba-8925-84d0db6947b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "cinder-quobyte-d6e859a7-e232-43ba-8925-84d0db6947b7" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:46 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2120691518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9d64ed-3048-4533-85ea-69182a3eeb06,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:44Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Creating volume 7a9d64ed-3048-4533-85ea-69182a3eeb06 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:46 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-quobyte-d6e859a7-e232-43ba-8925-84d0db6947b7" acquired by "delete_volume" :: waited 0.051s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:46 devstack sudo[98690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 1073741824
Aug 29 13:20:46 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde09de7-7f81-42a0-8740-d6f1230b4228]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:46 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7
Aug 29 13:20:46 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:47 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7" returned: 0 in 0.498s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:47 devstack sudo[98702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7
Aug 29 13:20:47 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:47 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 1073741824" returned: 0 in 0.728s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:47 devstack sudo[98704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06
Aug 29 13:20:47 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:47 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d6e859a7-e232-43ba-8925-84d0db6947b7" returned: 0 in 0.324s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-quobyte-d6e859a7-e232-43ba-8925-84d0db6947b7" released by "delete_volume" :: held 0.882s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Created reservations ['742956d2-bdcb-40cf-8a12-0eaf7c0a7b53', '47b40e2c-63da-4693-a5f3-d257e8168ac0', '573c5e67-0083-4e62-80c8-1a35f391a479', 'afe685eb-0cf2-4c61-8c0a-dce3706381a8'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:47 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06" returned: 0 in 0.360s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:47 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:47 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Attempting download of 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume 7a9d64ed-3048-4533-85ea-69182a3eeb06. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[82938e0c-65ff-40e9-bbf3-689479d44f8a]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_m3myo_6q {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:48 devstack sudo[98711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_m3myo_6q
Aug 29 13:20:48 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:48 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.312s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:48 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:48 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Deleted volume successfully.
Aug 29 13:20:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e7009b78-e9dd-44e6-aa84-80e43db27fb9 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-d6e859a7-e232-43ba-8925-84d0db6947b7-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:48 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_m3myo_6q" returned: 0 in 0.524s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_m3myo_6q {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:48 devstack sudo[98730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_m3myo_6q
Aug 29 13:20:48 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:49 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "cinder-63906ba1-aa18-41b4-80db-b74afbc5970c-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_m3myo_6q" returned: 1 in 0.670s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_m3myo_6q' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[30436488-27ce-42db-b247-bbae1d6462b1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-63906ba1-aa18-41b4-80db-b74afbc5970c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "cinder-quobyte-63906ba1-aa18-41b4-80db-b74afbc5970c" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-quobyte-63906ba1-aa18-41b4-80db-b74afbc5970c" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:49 devstack sudo[98776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD
Aug 29 13:20:49 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[df59e1a3-9a83-44ac-bd36-61794bf4c73a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:49 devstack sudo[98784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c
Aug 29 13:20:49 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:49 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD" returned: 0 in 0.650s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] 9ccc8465-2a9b-49d5-8097-23b2336c201f was qcow2, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:49 devstack sudo[98792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06
Aug 29 13:20:49 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:49 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c" returned: 0 in 0.564s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:50 devstack sudo[98798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c
Aug 29 13:20:50 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:50 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-63906ba1-aa18-41b4-80db-b74afbc5970c" returned: 0 in 0.330s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-quobyte-63906ba1-aa18-41b4-80db-b74afbc5970c" released by "delete_volume" :: held 1.027s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:50 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Created reservations ['62bf74fe-e445-47d6-943d-c63ecfca29fb', '612b4e76-1825-4532-8a98-49d4330e083a', '808a0737-460e-464c-82c1-c1d11f8729ed', '4ae76626-7d34-4a77-878c-5c2bbd6ec336'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:50 devstack sudo[98807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:50 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:51 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.552s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:51 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:51 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Deleted volume successfully.
Aug 29 13:20:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70b94150-6720-4f7a-9257-e4dbd2c74cc1 tempest-AttachVolumeTestJSON-2067344242 None] Lock "cinder-63906ba1-aa18-41b4-80db-b74afbc5970c-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:52 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06" returned: 0 in 3.042s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:52 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_206027dfdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:20:52 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Converted 112.00 MB image at 36.76 MB/s
Aug 29 13:20:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:52 devstack sudo[98814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 1G
Aug 29 13:20:52 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:53 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 1G" returned: 0 in 0.531s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Downloaded image 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume 7a9d64ed-3048-4533-85ea-69182a3eeb06 successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f for user fad7cb0d44fb41fc9f1d5f8356abc919 is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Marking volume 7a9d64ed-3048-4533-85ea-69182a3eeb06 as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Copying metadata from image 9ccc8465-2a9b-49d5-8097-23b2336c201f to 7a9d64ed-3048-4533-85ea-69182a3eeb06. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Creating volume glance metadata for volume 7a9d64ed-3048-4533-85ea-69182a3eeb06 backed by image 9ccc8465-2a9b-49d5-8097-23b2336c201f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2243c3-bad4-4a82-b209-137c454e4f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9d64ed-3048-4533-85ea-69182a3eeb06', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b616498200>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f715c53f-5b9e-460b-8add-ffbbe28781a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Volume volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 (7a9d64ed-3048-4533-85ea-69182a3eeb06): created successfully
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f715c53f-5b9e-460b-8add-ffbbe28781a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (1a1f2855-7bcb-4f58-8901-121b84e638d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f9e44fad-b6ca-4988-88b5-461fc50db81c tempest-VolumesGetTest-951104990 None] Created volume successfully.
Aug 29 13:20:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:20:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:54 devstack sudo[98820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:54 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (f1d240d3-f9d2-4c2e-adcb-bad36539d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b06b419-c6bd-418e-9625-74f1f604565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b06b419-c6bd-418e-9625-74f1f604565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1282009880',display_name='tempest-VolumesGetTest-Volume-201822304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e94b8a-55d9-4048-bed3-e8a8910aa8eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:55Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8836aa4-b341-45ed-82d7-0ba59d5cc9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8836aa4-b341-45ed-82d7-0ba59d5cc9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f76c1df-1dde-4cc7-a0b7-df44c6578b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f76c1df-1dde-4cc7-a0b7-df44c6578b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e94b8a-55d9-4048-bed3-e8a8910aa8eb', 'volume_name': 'volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999f594c-b4c5-4541-b54e-5c483ab2c60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999f594c-b4c5-4541-b54e-5c483ab2c60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6f9ac8-78cc-491e-bf2f-6ea8d89edd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:55 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Volume e1e94b8a-55d9-4048-bed3-e8a8910aa8eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb', 'volume_size': 1}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:20:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1282009880',display_name='tempest-VolumesGetTest-Volume-201822304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e94b8a-55d9-4048-bed3-e8a8910aa8eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1568fab5b824ec587ea8d37d0c844fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:20:55Z,use_quota=True,user_id='fad7cb0d44fb41fc9f1d5f8356abc919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Creating volume e1e94b8a-55d9-4048-bed3-e8a8910aa8eb {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:55 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:20:55 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.661s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:20:55 devstack sudo[98824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb 1073741824
Aug 29 13:20:55 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:55 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb 1073741824" returned: 0 in 0.631s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:55 devstack sudo[98833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb
Aug 29 13:20:55 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:56 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb" returned: 0 in 0.274s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:20:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6f9ac8-78cc-491e-bf2f-6ea8d89edd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9247ec5-d0e7-4b21-8d22-640fcde32aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:20:56 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Volume volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb (e1e94b8a-55d9-4048-bed3-e8a8910aa8eb): created successfully
Aug 29 13:20:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9247ec5-d0e7-4b21-8d22-640fcde32aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:20:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Flow 'volume_create_manager' (f1d240d3-f9d2-4c2e-adcb-bad36539d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:20:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-cbdc1f5a-1c0e-46bb-b87d-5a933a87a0c5 tempest-VolumesGetTest-951104990 None] Created volume successfully.
Aug 29 13:20:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Lock "cinder-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-quobyte-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:57 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a868d7a3-083f-4adb-859c-1e0a6ac152a0]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:57 devstack sudo[98836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb
Aug 29 13:20:57 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:57 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb" returned: 0 in 0.673s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:58 devstack sudo[98841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb
Aug 29 13:20:58 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:58 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb" returned: 0 in 0.347s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb" released by "delete_volume" :: held 1.086s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Created reservations ['3d8eedc4-4700-4bad-89fc-0b27940a36f2', '22d3a733-b11f-4435-b1d4-86b87a20a0ad', '98bdbfb3-dd63-42c3-8977-b23fbc0db9ce', '8301c5cb-0c92-4ee6-9fe5-9eb6c833766e'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:20:58 devstack sudo[98844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:20:58 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:20:58 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.460s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:20:58 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:20:59 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Deleted volume successfully.
Aug 29 13:20:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c47fc3fe-d587-4b0a-aeed-f196859b481f tempest-VolumesGetTest-951104990 None] Lock "cinder-e1e94b8a-55d9-4048-bed3-e8a8910aa8eb-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:20:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-7a9d64ed-3048-4533-85ea-69182a3eeb06-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Lock "cinder-7a9d64ed-3048-4533-85ea-69182a3eeb06-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Acquiring lock "cinder-quobyte-7a9d64ed-3048-4533-85ea-69182a3eeb06" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:20:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-7a9d64ed-3048-4533-85ea-69182a3eeb06" acquired by "delete_volume" :: waited 0.039s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:20:59 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ba9c55-639f-4d57-a612-7e98fac66d65]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:20:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:00 devstack sudo[98848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06
Aug 29 13:21:00 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:00 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06" returned: 0 in 0.739s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:00 devstack sudo[98854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06
Aug 29 13:21:00 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Flow 'volume_create_manager' (5af3d54c-1d8c-4188-8efa-9ec07253a44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7163b9-de20-4901-b543-c944a129fd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7163b9-de20-4901-b543-c944a129fd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-900839424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e29d92-1b84-43c7-8c16-967f74f04d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3708b92adf2419392914131055436bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:01Z,use_quota=True,user_id='bcd90d0090c0429d8b7f318dccd6a759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5258e8-e097-444f-bd9d-1d8522e26ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5258e8-e097-444f-bd9d-1d8522e26ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7152ed36-bab3-4cb7-aa8a-0034aa7caf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:00 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:21:01 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7a9d64ed-3048-4533-85ea-69182a3eeb06" returned: 0 in 0.550s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Lock "cinder-quobyte-7a9d64ed-3048-4533-85ea-69182a3eeb06" released by "delete_volume" :: held 1.389s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Created reservations ['bede6870-e1c9-4fdf-a7bb-3f79a13981f0', 'ac49ee2e-d441-4b91-bd91-bff74bdadc44', '5bcaf70f-faf6-46c7-b200-9d71f9cec825', 'b9c90293-61fa-4c0e-a870-0b7186ac987e'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7152ed36-bab3-4cb7-aa8a-0034aa7caf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00e29d92-1b84-43c7-8c16-967f74f04d60', 'volume_name': 'volume-00e29d92-1b84-43c7-8c16-967f74f04d60', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b62083b230>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85072380-4102-48da-989b-68b179ef97f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85072380-4102-48da-989b-68b179ef97f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb76797-e0f2-4d15-90fb-8f9a8f8fa457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:01 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Volume 00e29d92-1b84-43c7-8c16-967f74f04d60: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00e29d92-1b84-43c7-8c16-967f74f04d60', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b62083b230>}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Trying to clone 00e29d92-1b84-43c7-8c16-967f74f04d60 from image 9ccc8465-2a9b-49d5-8097-23b2336c201f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:01 devstack sudo[98858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:01 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:02 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.619s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:02 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Deleted volume successfully.
Aug 29 13:21:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a711bc4a-41e1-4d45-9773-0a97bac25f26 tempest-VolumesGetTest-951104990 None] Lock "cinder-7a9d64ed-3048-4533-85ea-69182a3eeb06-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:02 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:21:02 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Image download 20.69 MB at 20.69 MB/s
Aug 29 13:21:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b73c808-8898-4566-91c9-1c1eeb681fe5]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:02 devstack sudo[98862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD
Aug 29 13:21:02 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:03 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f is fetched for user bcd90d0090c0429d8b7f318dccd6a759. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe62124b-1c9b-44ab-bfa4-2df1831a8868]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:03 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD
Aug 29 13:21:03 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:03 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD" returned: 0 in 0.505s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-900839424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e29d92-1b84-43c7-8c16-967f74f04d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3708b92adf2419392914131055436bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:01Z,use_quota=True,user_id='bcd90d0090c0429d8b7f318dccd6a759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Creating volume 00e29d92-1b84-43c7-8c16-967f74f04d60 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:03 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:03 devstack sudo[98893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 1073741824
Aug 29 13:21:03 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:04 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 1073741824" returned: 0 in 0.610s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:04 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60
Aug 29 13:21:04 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:04 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60" returned: 0 in 0.272s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Attempting download of 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume 00e29d92-1b84-43c7-8c16-967f74f04d60. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5537e23d-f821-4fe3-a425-90f56a83eb63]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_345sbo2g {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1417c41-5e5b-4c73-b84f-8766fc626999 tempest-BackendsCapabilitiesAdminTestsJSON-2010314074 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5325202941895, 'free_capacity_gb': 1774.5325202941895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85771) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 29 13:21:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-84107d89-fc5d-4be2-8bf4-c6ac39cbdf45 tempest-BackendsCapabilitiesAdminTestsJSON-2010314074 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5325202941895, 'free_capacity_gb': 1774.5325202941895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85771) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 29 13:21:04 devstack sudo[98902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_345sbo2g
Aug 29 13:21:04 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:05 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_345sbo2g" returned: 0 in 0.426s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_345sbo2g {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:05 devstack sudo[98906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_345sbo2g
Aug 29 13:21:05 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:05 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_345sbo2g" returned: 1 in 0.365s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ccc8465-2a9b-49d5-8097-23b2336c201f_345sbo2g' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:21:05 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[716f773c-3ae0-48ab-b3d2-28d3822b23b1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:05 devstack sudo[98910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD
Aug 29 13:21:05 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:05 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:05 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] 9ccc8465-2a9b-49d5-8097-23b2336c201f was qcow2, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:21:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:05 devstack sudo[98915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60
Aug 29 13:21:05 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Flow 'volume_create_manager' (9b6c9895-ec25-4915-a36a-808daa00c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ad818-5f1b-4e2a-bf13-824f5fbb3f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ad818-5f1b-4e2a-bf13-824f5fbb3f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1732622548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3f631c-b74f-445c-91be-2a42acbd6307,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4fac1fcc71466fb0a0b0b6369bd02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:06Z,use_quota=True,user_id='9db8238720c143d9b759f157adaf3ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53c2ace-ec64-4692-bcf6-daaed9cab8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53c2ace-ec64-4692-bcf6-daaed9cab8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2b4936-370d-4a31-9355-77624bd7f082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2b4936-370d-4a31-9355-77624bd7f082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3f631c-b74f-445c-91be-2a42acbd6307', 'volume_name': 'volume-dc3f631c-b74f-445c-91be-2a42acbd6307', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c4c0e1-8785-473c-9c4a-6826c4449874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c4c0e1-8785-473c-9c4a-6826c4449874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86276f5a-c02a-4c1f-8ee1-f9ea2d1ca307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:06 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Volume dc3f631c-b74f-445c-91be-2a42acbd6307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3f631c-b74f-445c-91be-2a42acbd6307', 'volume_size': 1}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1732622548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3f631c-b74f-445c-91be-2a42acbd6307,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4fac1fcc71466fb0a0b0b6369bd02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:06Z,use_quota=True,user_id='9db8238720c143d9b759f157adaf3ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Creating volume dc3f631c-b74f-445c-91be-2a42acbd6307 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:06 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:06 devstack sudo[98921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307 1073741824
Aug 29 13:21:06 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:06 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307 1073741824" returned: 0 in 0.619s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:07 devstack sudo[98929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307
Aug 29 13:21:07 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:07 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86276f5a-c02a-4c1f-8ee1-f9ea2d1ca307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3f631c-b74f-445c-91be-2a42acbd6307', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fe9066-3c4b-4a5a-b616-4594f18f6147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:07 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Volume volume-dc3f631c-b74f-445c-91be-2a42acbd6307 (dc3f631c-b74f-445c-91be-2a42acbd6307): created successfully
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fe9066-3c4b-4a5a-b616-4594f18f6147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Flow 'volume_create_manager' (9b6c9895-ec25-4915-a36a-808daa00c733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a89d5944-a506-4b73-8d22-c28071d1d19a tempest-VolumesListTestJSON-685953296 None] Created volume successfully.
Aug 29 13:21:07 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60" returned: 0 in 2.024s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ccc8465-2a9b-49d5-8097-23b2336c201f_1wgoekh5devstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:21:07 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Converted 112.00 MB image at 55.30 MB/s
Aug 29 13:21:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:07 devstack sudo[98932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 1G
Aug 29 13:21:07 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:08 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 1G" returned: 0 in 0.348s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Downloaded image 9ccc8465-2a9b-49d5-8097-23b2336c201f ((None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}])) to volume 00e29d92-1b84-43c7-8c16-967f74f04d60 successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Temporary image 9ccc8465-2a9b-49d5-8097-23b2336c201f for user bcd90d0090c0429d8b7f318dccd6a759 is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Marking volume 00e29d92-1b84-43c7-8c16-967f74f04d60 as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Copying metadata from image 9ccc8465-2a9b-49d5-8097-23b2336c201f to 00e29d92-1b84-43c7-8c16-967f74f04d60. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Creating volume glance metadata for volume 00e29d92-1b84-43c7-8c16-967f74f04d60 backed by image 9ccc8465-2a9b-49d5-8097-23b2336c201f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb76797-e0f2-4d15-90fb-8f9a8f8fa457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e29d92-1b84-43c7-8c16-967f74f04d60', 'volume_size': 1, 'image_id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ccc8465-2a9b-49d5-8097-23b2336c201f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '702e645bd1ca4b44a627814fb1c926ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ccc8465-2a9b-49d5-8097-23b2336c201f', 'created_at': datetime.datetime(2026, 8, 29, 11, 3, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 3, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ccc8465-2a9b-49d5-8097-23b2336c201f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b62083b230>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73be01f7-f20a-4703-8c2c-655c5c5e6f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:08 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Volume volume-00e29d92-1b84-43c7-8c16-967f74f04d60 (00e29d92-1b84-43c7-8c16-967f74f04d60): created successfully
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73be01f7-f20a-4703-8c2c-655c5c5e6f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Flow 'volume_create_manager' (5af3d54c-1d8c-4188-8efa-9ec07253a44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:08 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a536f90c-7332-4268-9c08-0678a2956305 tempest-TestShelveInstance-1250222549 None] Created volume successfully.
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Flow 'volume_create_manager' (1e71cc4c-30a3-4888-a166-b7885d498042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4351f84a-eb9e-48f3-a0a0-33612995956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4351f84a-eb9e-48f3-a0a0-33612995956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1321669836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55126142-356f-4179-8425-16d2db14d3da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4fac1fcc71466fb0a0b0b6369bd02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:09Z,use_quota=True,user_id='9db8238720c143d9b759f157adaf3ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1ae6b2-b6b9-4d8e-9d8d-8ca8c6718094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1ae6b2-b6b9-4d8e-9d8d-8ca8c6718094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31674d2f-1304-42be-b860-5e994519587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31674d2f-1304-42be-b860-5e994519587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55126142-356f-4179-8425-16d2db14d3da', 'volume_name': 'volume-55126142-356f-4179-8425-16d2db14d3da', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d261e8-56f8-4bf8-a00b-27603bafa592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d261e8-56f8-4bf8-a00b-27603bafa592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef82a66-d2ca-4109-86a9-4ab2d7556d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:08 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Volume 55126142-356f-4179-8425-16d2db14d3da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55126142-356f-4179-8425-16d2db14d3da', 'volume_size': 1}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1321669836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55126142-356f-4179-8425-16d2db14d3da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4fac1fcc71466fb0a0b0b6369bd02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:09Z,use_quota=True,user_id='9db8238720c143d9b759f157adaf3ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Creating volume 55126142-356f-4179-8425-16d2db14d3da {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:09 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:09 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da 1073741824
Aug 29 13:21:09 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:09 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da 1073741824" returned: 0 in 0.493s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:09 devstack sudo[98943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da
Aug 29 13:21:09 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:09 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da" returned: 0 in 0.335s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef82a66-d2ca-4109-86a9-4ab2d7556d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55126142-356f-4179-8425-16d2db14d3da', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c943cac-db09-41b2-a6f5-53806ad3292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:09 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Volume volume-55126142-356f-4179-8425-16d2db14d3da (55126142-356f-4179-8425-16d2db14d3da): created successfully
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c943cac-db09-41b2-a6f5-53806ad3292a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Flow 'volume_create_manager' (1e71cc4c-30a3-4888-a166-b7885d498042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9e242fa2-67a0-44c0-90e4-3fa1f2109f7a tempest-VolumesListTestJSON-685953296 None] Created volume successfully.
Aug 29 13:21:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-28f8798b-1228-45da-820f-a30c5ec8972f tempest-GroupsTest-909989702 None] Group tempest-Group1-1071033952: creating
Aug 29 13:21:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-28f8798b-1228-45da-820f-a30c5ec8972f tempest-GroupsTest-909989702 None] Group tempest-Group1-1071033952: created successfully
Aug 29 13:21:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-28f8798b-1228-45da-820f-a30c5ec8972f tempest-GroupsTest-909989702 None] Create group completed successfully.
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Flow 'volume_create_manager' (8f54ff35-82f2-45df-8894-3bd461e5030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add07af8-e3de-461e-8ddb-6cd4da0175fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add07af8-e3de-461e-8ddb-6cd4da0175fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-782195357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bce476-96a5-440d-918c-c02e51cd8bf0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4fac1fcc71466fb0a0b0b6369bd02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:12Z,use_quota=True,user_id='9db8238720c143d9b759f157adaf3ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c3ecd7-126d-4e9f-88a0-6f55a231ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c3ecd7-126d-4e9f-88a0-6f55a231ff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40dd647-503c-4136-aa63-3db27d1ddc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40dd647-503c-4136-aa63-3db27d1ddc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1bce476-96a5-440d-918c-c02e51cd8bf0', 'volume_name': 'volume-a1bce476-96a5-440d-918c-c02e51cd8bf0', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7736e592-f416-4de9-84e7-1b461e6dcc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7736e592-f416-4de9-84e7-1b461e6dcc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7f14c0-366e-459b-887d-5611dcdbf1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:11 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Volume a1bce476-96a5-440d-918c-c02e51cd8bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1bce476-96a5-440d-918c-c02e51cd8bf0', 'volume_size': 1}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-782195357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bce476-96a5-440d-918c-c02e51cd8bf0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4fac1fcc71466fb0a0b0b6369bd02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:12Z,use_quota=True,user_id='9db8238720c143d9b759f157adaf3ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Creating volume a1bce476-96a5-440d-918c-c02e51cd8bf0 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:11 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:11 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7ee8d55d-2ed6-482d-bb50-0c6ee8a76f7d tempest-GroupsTest-909989702 None] Group tempest-Group2-1561814004: creating
Aug 29 13:21:11 devstack sudo[98949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0 1073741824
Aug 29 13:21:11 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:11 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7ee8d55d-2ed6-482d-bb50-0c6ee8a76f7d tempest-GroupsTest-909989702 None] Group tempest-Group2-1561814004: created successfully
Aug 29 13:21:11 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7ee8d55d-2ed6-482d-bb50-0c6ee8a76f7d tempest-GroupsTest-909989702 None] Create group completed successfully.
Aug 29 13:21:12 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0 1073741824" returned: 0 in 0.589s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:12 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0
Aug 29 13:21:12 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-c9f5effb-71a1-444f-86b9-7703609f5d3f req-b1fc17d2-3955-49f9-8aa5-b2a254798515 tempest-TestShelveInstance-1250222549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:12 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0" returned: 0 in 0.310s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-c9f5effb-71a1-444f-86b9-7703609f5d3f req-b1fc17d2-3955-49f9-8aa5-b2a254798515 tempest-TestShelveInstance-1250222549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.131s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-c9f5effb-71a1-444f-86b9-7703609f5d3f req-b1fc17d2-3955-49f9-8aa5-b2a254798515 tempest-TestShelveInstance-1250222549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7f14c0-366e-459b-887d-5611dcdbf1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1bce476-96a5-440d-918c-c02e51cd8bf0', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b19fa8-9990-4f91-984c-d393a24b4d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:12 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Volume volume-a1bce476-96a5-440d-918c-c02e51cd8bf0 (a1bce476-96a5-440d-918c-c02e51cd8bf0): created successfully
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b19fa8-9990-4f91-984c-d393a24b4d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Flow 'volume_create_manager' (8f54ff35-82f2-45df-8894-3bd461e5030a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8c52696e-eae9-4a2a-b9d7-905aaaea37d6 tempest-VolumesListTestJSON-685953296 None] Created volume successfully.
Aug 29 13:21:12 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-c9f5effb-71a1-444f-86b9-7703609f5d3f req-b1fc17d2-3955-49f9-8aa5-b2a254798515 tempest-TestShelveInstance-1250222549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-00e29d92-1b84-43c7-8c16-967f74f04d60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63f2cccd-b50c-405f-b08a-530d0e925dcf', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:21:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-c9f5effb-71a1-444f-86b9-7703609f5d3f req-b1fc17d2-3955-49f9-8aa5-b2a254798515 tempest-TestShelveInstance-1250222549 None] attachment_update completed successfully.
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Flow 'volume_create_manager' (6a14727a-3701-4541-a2b5-cb23bd7ee6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b9c86b-85d1-4fdf-a791-4289ec856300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b9c86b-85d1-4fdf-a791-4289ec856300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-273033673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7491bcca-b341-4395-aa0c-d60402bed351,host='devstack@QuobyteHD#QuobyteHD',id=dcb4de56-ec92-4227-8605-71326ecf1c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ca2b53aa6a45cf92a073e6161a26eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:14Z,use_quota=True,user_id='8a69566e6ec746beaed295ff96fad22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ae4346f-2162-4e80-b8e7-3085d1e37fa6),volume_type_id=0ae4346f-2162-4e80-b8e7-3085d1e37fa6)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888f1923-4678-4819-ace4-e0a74ef9683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888f1923-4678-4819-ace4-e0a74ef9683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ecb1c5-6c01-48bd-a27e-4bceff8ee998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ecb1c5-6c01-48bd-a27e-4bceff8ee998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb4de56-ec92-4227-8605-71326ecf1c07', 'volume_name': 'volume-dcb4de56-ec92-4227-8605-71326ecf1c07', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce8f44c-bbad-4632-a3d0-0da48d028ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce8f44c-bbad-4632-a3d0-0da48d028ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846ab528-6d58-463b-992f-478fd4dd16c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:13 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Volume dcb4de56-ec92-4227-8605-71326ecf1c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb4de56-ec92-4227-8605-71326ecf1c07', 'volume_size': 1}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7491bcca-b341-4395-aa0c-d60402bed351,created_at=2026-08-29T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-273033673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7491bcca-b341-4395-aa0c-d60402bed351,host='devstack@QuobyteHD#QuobyteHD',id=dcb4de56-ec92-4227-8605-71326ecf1c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ca2b53aa6a45cf92a073e6161a26eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:14Z,use_quota=True,user_id='8a69566e6ec746beaed295ff96fad22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ae4346f-2162-4e80-b8e7-3085d1e37fa6),volume_type_id=0ae4346f-2162-4e80-b8e7-3085d1e37fa6)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Creating volume dcb4de56-ec92-4227-8605-71326ecf1c07 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:13 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:14 devstack sudo[98975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07 1073741824
Aug 29 13:21:14 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=126,cinder:INSERT=36,cinder:UPDATE=112,cinder:DELETE=11 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:21:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=97,cinder:INSERT=39,cinder:UPDATE=121,cinder:DELETE=9 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:21:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-7009ee87-909b-451d-a665-45b312ca1871 req-e00449c7-c2ce-41e0-875e-1d6843f298be tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:14 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07 1073741824" returned: 0 in 0.625s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:14 devstack sudo[98988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07
Aug 29 13:21:14 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:15 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07" returned: 0 in 0.396s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-7009ee87-909b-451d-a665-45b312ca1871 req-e00449c7-c2ce-41e0-875e-1d6843f298be tempest-TestStampPattern-1653392327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.720s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846ab528-6d58-463b-992f-478fd4dd16c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb4de56-ec92-4227-8605-71326ecf1c07', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5a2dce-58b0-443c-b380-afc46f426d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-7009ee87-909b-451d-a665-45b312ca1871 req-e00449c7-c2ce-41e0-875e-1d6843f298be tempest-TestStampPattern-1653392327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:15 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Volume volume-dcb4de56-ec92-4227-8605-71326ecf1c07 (dcb4de56-ec92-4227-8605-71326ecf1c07): created successfully
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5a2dce-58b0-443c-b380-afc46f426d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Flow 'volume_create_manager' (6a14727a-3701-4541-a2b5-cb23bd7ee6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9d010974-bce6-4d8e-95ca-52486b7ac73a tempest-GroupsTest-909989702 None] Created volume successfully.
Aug 29 13:21:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-7009ee87-909b-451d-a665-45b312ca1871 req-e00449c7-c2ce-41e0-875e-1d6843f298be tempest-TestStampPattern-1653392327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-40e56b36-0258-47ed-9265-627189a7fec4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91877a75-4a7a-4b86-b4a1-aea1e655b537', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:21:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-7009ee87-909b-451d-a665-45b312ca1871 req-e00449c7-c2ce-41e0-875e-1d6843f298be tempest-TestStampPattern-1653392327 None] attachment_update completed successfully.
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Acquiring lock "cinder-a1bce476-96a5-440d-918c-c02e51cd8bf0-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Lock "cinder-a1bce476-96a5-440d-918c-c02e51cd8bf0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Acquiring lock "cinder-quobyte-a1bce476-96a5-440d-918c-c02e51cd8bf0" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Lock "cinder-quobyte-a1bce476-96a5-440d-918c-c02e51cd8bf0" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[28713208-5e3f-4bc1-8e63-ee77285400f7]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:17 devstack sudo[99441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0
Aug 29 13:21:17 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Acquiring lock "cinder-quobyte-dcb4de56-ec92-4227-8605-71326ecf1c07" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Lock "cinder-quobyte-dcb4de56-ec92-4227-8605-71326ecf1c07" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca7edaa-45d6-4789-b931-51898ec2d117]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:18 devstack sudo[99451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07
Aug 29 13:21:18 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:18 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0" returned: 0 in 0.643s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:18 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0
Aug 29 13:21:18 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:18 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a1bce476-96a5-440d-918c-c02e51cd8bf0" returned: 0 in 0.396s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Lock "cinder-quobyte-a1bce476-96a5-440d-918c-c02e51cd8bf0" released by "delete_volume" :: held 1.093s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:18 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07" returned: 0 in 0.748s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:18 devstack sudo[99464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07
Aug 29 13:21:18 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Created reservations ['e29a369a-4d8b-4eec-a66a-ae8066f9e91b', '11bd6aad-9862-46ef-a149-196262761a47', '33496013-4300-4b50-a791-f3c18f0337c3', '799b2412-dcbf-4f63-aea0-4fd335bd0261'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:18 devstack sudo[99466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:18 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:18 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dcb4de56-ec92-4227-8605-71326ecf1c07" returned: 0 in 0.374s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Lock "cinder-quobyte-dcb4de56-ec92-4227-8605-71326ecf1c07" released by "delete_volume" :: held 1.217s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Created reservations ['832f4b40-3949-47c9-9876-62d2a439309f'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:19 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.411s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:19 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Deleted volume successfully.
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a6d84b13-4c49-4b14-8c2e-25a4ce990776 tempest-VolumesListTestJSON-685953296 None] Lock "cinder-a1bce476-96a5-440d-918c-c02e51cd8bf0-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:19 devstack cinder-volume[85771]: WARNING cinder.quota [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1054142644 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1054142644, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:21:19 devstack cinder-volume[85771]: WARNING cinder.quota [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1054142644 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1054142644, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Created reservations ['8631ac50-d6c9-4186-a570-db01a3236249', 'a60093a2-8408-4f42-abe9-6e9b77d533e7', '6e321198-a9bf-4f26-a8dd-92022db54e6b', '1d2b7427-66ce-4341-9a34-6570be9df433'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:19 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:19 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:19 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.318s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:19 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-989da1da-2a71-448f-9a06-1482dd28374a tempest-GroupsTest-909989702 None] Delete group completed successfully.
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Acquiring lock "cinder-55126142-356f-4179-8425-16d2db14d3da-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Lock "cinder-55126142-356f-4179-8425-16d2db14d3da-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Acquiring lock "cinder-quobyte-55126142-356f-4179-8425-16d2db14d3da" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Lock "cinder-quobyte-55126142-356f-4179-8425-16d2db14d3da" acquired by "delete_volume" :: waited 0.052s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b43e542-2989-4f30-87ad-84720903d9d2]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:20 devstack sudo[99474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da
Aug 29 13:21:20 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:20 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da" returned: 0 in 0.472s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:20 devstack sudo[99482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da
Aug 29 13:21:20 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] Created reservations ['6b438952-4e0d-4084-9119-007b9f6492a6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:20 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55126142-356f-4179-8425-16d2db14d3da" returned: 0 in 0.403s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:20 devstack sudo[99489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:20 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:20 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Lock "cinder-quobyte-55126142-356f-4179-8425-16d2db14d3da" released by "delete_volume" :: held 0.964s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Created reservations ['2bd3af4d-0607-4646-823e-e2a5a7c2bb84', '69a86119-9600-4126-8816-3eb7915611ad', '73e1de5e-30bc-45c6-99b8-3f3a9bc85730', 'f5571c04-df21-40cf-a742-0c6c2534fd07'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:21 devstack sudo[99496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:21 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:21 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.530s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-76327ef9-cbba-43ba-b93b-76a5f1e6fb55 tempest-GroupsTest-909989702 None] Delete group completed successfully.
Aug 29 13:21:21 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.459s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Deleted volume successfully.
Aug 29 13:21:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5e55faed-cd06-42a0-9101-6b2a727cef7c tempest-VolumesListTestJSON-685953296 None] Lock "cinder-55126142-356f-4179-8425-16d2db14d3da-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-63312fc9-ce22-4baf-a6f2-fc0d8d4eead1 req-07019e80-e541-461a-b4e0-5c6b05deed11 tempest-TestStampPattern-1653392327 None] Terminate volume connection completed successfully.
Aug 29 13:21:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-63312fc9-ce22-4baf-a6f2-fc0d8d4eead1 req-07019e80-e541-461a-b4e0-5c6b05deed11 tempest-TestStampPattern-1653392327 None] Deleting attachment 91877a75-4a7a-4b86-b4a1-aea1e655b537. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:21:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Acquiring lock "cinder-dc3f631c-b74f-445c-91be-2a42acbd6307-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Lock "cinder-dc3f631c-b74f-445c-91be-2a42acbd6307-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Acquiring lock "cinder-quobyte-dc3f631c-b74f-445c-91be-2a42acbd6307" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Lock "cinder-quobyte-dc3f631c-b74f-445c-91be-2a42acbd6307" acquired by "delete_volume" :: waited 0.041s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:22 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b470f1-ccf6-4134-84ae-0f103b84058d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:22 devstack sudo[99503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307
Aug 29 13:21:22 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6dbf93b9-14de-4554-b1b4-eb714b7d7bfc tempest-GroupsTest-909989702 None] Group tempest-GroupsTest-Group-1692138513: creating
Aug 29 13:21:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6dbf93b9-14de-4554-b1b4-eb714b7d7bfc tempest-GroupsTest-909989702 None] Group tempest-GroupsTest-Group-1692138513: created successfully
Aug 29 13:21:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6dbf93b9-14de-4554-b1b4-eb714b7d7bfc tempest-GroupsTest-909989702 None] Create group completed successfully.
Aug 29 13:21:23 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307" returned: 0 in 0.723s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:23 devstack sudo[99532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307
Aug 29 13:21:23 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Creating offline snapshot e120c9c5-1d28-4afc-8150-8b3cdeb2fbde of volume 40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50ebad8-ce7b-4be6-8db7-6e1d1e26e28a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:23 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4
Aug 29 13:21:23 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:23 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dc3f631c-b74f-445c-91be-2a42acbd6307" returned: 0 in 0.432s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Lock "cinder-quobyte-dc3f631c-b74f-445c-91be-2a42acbd6307" released by "delete_volume" :: held 1.255s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:23 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Created reservations ['da1fa431-fab6-4339-8dc7-aef747b231af', 'c4a06244-cb67-47dd-a245-7950a91f6714', '9760e92c-2416-41b7-a7a9-c6ca69a4d82f', '0e3f2937-56a0-465c-a829-67dd41a8c443'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:24 devstack sudo[99554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:24 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:24 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4" returned: 0 in 0.854s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:24 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde 1G
Aug 29 13:21:24 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:24 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.489s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Deleted volume successfully.
Aug 29 13:21:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f82e7993-4abd-4cff-822c-6ddd8c95e532 tempest-VolumesListTestJSON-685953296 None] Lock "cinder-dc3f631c-b74f-445c-91be-2a42acbd6307-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:25 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Flow 'volume_create_manager' (3195f10f-b736-4033-a724-66db46c9d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999db93a-8d26-4722-9e83-a64b939fc398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde 1G" returned: 0 in 0.809s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40e56b36-0258-47ed-9265-627189a7fec4 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999db93a-8d26-4722-9e83-a64b939fc398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258149297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5fcaf41-d25f-46c3-90a0-370d484463f2,host='devstack@QuobyteHD#QuobyteHD',id=1fa1720b-6b3f-4614-b205-2d023581473e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ca2b53aa6a45cf92a073e6161a26eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:25Z,use_quota=True,user_id='8a69566e6ec746beaed295ff96fad22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dee789-b219-4cf7-8bc9-541b15695aee),volume_type_id=79dee789-b219-4cf7-8bc9-541b15695aee)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8639ac-b550-4fc7-a02a-c4cc0bae5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8639ac-b550-4fc7-a02a-c4cc0bae5f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:25 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40e56b36-0258-47ed-9265-627189a7fec4 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde
Aug 29 13:21:25 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915ee19d-57a8-4cf6-8e75-0f735df8d0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915ee19d-57a8-4cf6-8e75-0f735df8d0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa1720b-6b3f-4614-b205-2d023581473e', 'volume_name': 'volume-1fa1720b-6b3f-4614-b205-2d023581473e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256b142e-84cc-495e-8ce1-f2a7137da1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256b142e-84cc-495e-8ce1-f2a7137da1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21d96da-a4c3-4793-9518-b06a9935c0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:25 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Volume 1fa1720b-6b3f-4614-b205-2d023581473e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa1720b-6b3f-4614-b205-2d023581473e', 'volume_size': 1}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:25 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40e56b36-0258-47ed-9265-627189a7fec4 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:25 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde is being set with open permissions: ugo+rw
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:25 devstack sudo[99571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde
Aug 29 13:21:25 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:25 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde" returned: 0 in 0.254s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:25 devstack sudo[99574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.info
Aug 29 13:21:25 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:26 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.info" returned: 0 in 0.312s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:26 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.info is being set with open permissions: ugo+rw
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:26 devstack sudo[99577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.info
Aug 29 13:21:26 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:26 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.info" returned: 0 in 0.286s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.984s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.193s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b5fcaf41-d25f-46c3-90a0-370d484463f2,created_at=2026-08-29T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258149297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5fcaf41-d25f-46c3-90a0-370d484463f2,host='devstack@QuobyteHD#QuobyteHD',id=1fa1720b-6b3f-4614-b205-2d023581473e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ca2b53aa6a45cf92a073e6161a26eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:25Z,use_quota=True,user_id='8a69566e6ec746beaed295ff96fad22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dee789-b219-4cf7-8bc9-541b15695aee),volume_type_id=79dee789-b219-4cf7-8bc9-541b15695aee)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Creating volume 1fa1720b-6b3f-4614-b205-2d023581473e {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:26 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:26 devstack sudo[99580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e 1073741824
Aug 29 13:21:26 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2ada66ea-1498-4bce-b67e-f21e69e1a211 tempest-TestStampPattern-1653392327 None] Create snapshot completed successfully
Aug 29 13:21:27 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e 1073741824" returned: 0 in 0.576s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:27 devstack sudo[99586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e
Aug 29 13:21:27 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:27 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e" returned: 0 in 0.297s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21d96da-a4c3-4793-9518-b06a9935c0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa1720b-6b3f-4614-b205-2d023581473e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3522a2ad-0189-457b-b7f3-e1970571a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:27 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Volume volume-1fa1720b-6b3f-4614-b205-2d023581473e (1fa1720b-6b3f-4614-b205-2d023581473e): created successfully
Aug 29 13:21:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3522a2ad-0189-457b-b7f3-e1970571a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Flow 'volume_create_manager' (3195f10f-b736-4033-a724-66db46c9d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:27 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7e8ea91b-175f-4072-8a56-220040f2198e tempest-GroupsTest-909989702 None] Created volume successfully.
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (bd46b8e8-9fc1-4c40-b092-1195be51b55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df3af30-4f6d-4772-af4e-cf812f2ef351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df3af30-4f6d-4772-af4e-cf812f2ef351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1766045720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e726d5-2712-468d-b4a0-ac0deccc5b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:28Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d254cc0-9e5f-4c3f-b681-8fa7680c4330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d254cc0-9e5f-4c3f-b681-8fa7680c4330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434f805a-b70f-4e5d-8ef6-fcbd955fd75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434f805a-b70f-4e5d-8ef6-fcbd955fd75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8e726d5-2712-468d-b4a0-ac0deccc5b9f', 'volume_name': 'volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64eb13b8-6863-49f0-91d2-a59c0f29574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64eb13b8-6863-49f0-91d2-a59c0f29574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd10063f-ddc2-47fb-bcf2-de01cb1ea6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:28 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Volume c8e726d5-2712-468d-b4a0-ac0deccc5b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f', 'volume_size': 1}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1766045720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e726d5-2712-468d-b4a0-ac0deccc5b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:28Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Creating volume c8e726d5-2712-468d-b4a0-ac0deccc5b9f {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:28 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:28 devstack sudo[99597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f 1073741824
Aug 29 13:21:28 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (81da71a8-6fcc-4629-82f3-3f64b27b07f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7f03a7-0e76-4077-a9d2-ef9b4eb12b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7f03a7-0e76-4077-a9d2-ef9b4eb12b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52996772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce73210-cd30-4e1a-b0df-eb27cc10c9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:29Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5672f3-f4f5-4469-ae79-761274946228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5672f3-f4f5-4469-ae79-761274946228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8a8feb-5d03-4fb7-9d5a-7119c2aae2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8a8feb-5d03-4fb7-9d5a-7119c2aae2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce73210-cd30-4e1a-b0df-eb27cc10c9af', 'volume_name': 'volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f01ae4e-eb7a-4373-b06e-f4284a59bf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f01ae4e-eb7a-4373-b06e-f4284a59bf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31451fa-d58c-4ef0-a278-5cac5f01708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Volume 9ce73210-cd30-4e1a-b0df-eb27cc10c9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af', 'volume_size': 1}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (13f307e7-cb0c-44b6-b554-e05c1a33b0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f51f80-58d8-41e2-8801-9caf3a47ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f51f80-58d8-41e2-8801-9caf3a47ee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-64124149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d2a263-a359-4cc4-91e5-fadcd4f828cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:30Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9a026b-0228-48b2-be09-d1fdc2d1be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9a026b-0228-48b2-be09-d1fdc2d1be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbe551c-e38c-4151-a322-ef6df52d90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbe551c-e38c-4151-a322-ef6df52d90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d2a263-a359-4cc4-91e5-fadcd4f828cb', 'volume_name': 'volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6172632-06f1-4d96-9e40-2b7ed09e0350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6172632-06f1-4d96-9e40-2b7ed09e0350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15109d4c-f2e4-4db0-bbdd-dc215d56f093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:29 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Volume 64d2a263-a359-4cc4-91e5-fadcd4f828cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb', 'volume_size': 1}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:29 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f 1073741824" returned: 0 in 1.008s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:30 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f
Aug 29 13:21:30 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:30 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f" returned: 0 in 0.469s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52996772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce73210-cd30-4e1a-b0df-eb27cc10c9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:29Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Creating volume 9ce73210-cd30-4e1a-b0df-eb27cc10c9af {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:30 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd10063f-ddc2-47fb-bcf2-de01cb1ea6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:30 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af 1073741824
Aug 29 13:21:30 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e60258-787c-46ee-83eb-4a0b8d0d9a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:30 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Volume volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f (c8e726d5-2712-468d-b4a0-ac0deccc5b9f): created successfully
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e60258-787c-46ee-83eb-4a0b8d0d9a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (bd46b8e8-9fc1-4c40-b092-1195be51b55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:30 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ebe79970-93a5-4f91-b3be-7734de227bb2 tempest-CreateVolumesFromImageTest-1951201129 None] Created volume successfully.
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Flow 'volume_create_manager' (0957516d-e1ad-4727-8eed-51f882e9eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835a1f5c-a507-4d0e-b109-598a82293051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835a1f5c-a507-4d0e-b109-598a82293051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-286506904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5fcaf41-d25f-46c3-90a0-370d484463f2,host='devstack@QuobyteHD#QuobyteHD',id=b3e77408-346e-4af1-9dca-c38b2f379ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ca2b53aa6a45cf92a073e6161a26eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:31Z,use_quota=True,user_id='8a69566e6ec746beaed295ff96fad22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dee789-b219-4cf7-8bc9-541b15695aee),volume_type_id=79dee789-b219-4cf7-8bc9-541b15695aee)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1b9a7a-5b64-4cdf-95a9-770eb882e58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1b9a7a-5b64-4cdf-95a9-770eb882e58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef72994-1490-4544-be86-c62cb9cba88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef72994-1490-4544-be86-c62cb9cba88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e77408-346e-4af1-9dca-c38b2f379ea2', 'volume_name': 'volume-b3e77408-346e-4af1-9dca-c38b2f379ea2', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c336f6e-8789-41be-b8cb-101a3175d071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c336f6e-8789-41be-b8cb-101a3175d071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafc1ae9-77bf-45d1-8c68-fca5ff421f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:30 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Volume b3e77408-346e-4af1-9dca-c38b2f379ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e77408-346e-4af1-9dca-c38b2f379ea2', 'volume_size': 1}
Aug 29 13:21:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (bb575d0b-c75a-4dae-bcd2-f3dd05f8bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8f4701-b369-4f99-8985-93f647efbbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8f4701-b369-4f99-8985-93f647efbbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165064692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:31Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a94e627-0a34-4c2f-a4c5-ec3ce3889d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a94e627-0a34-4c2f-a4c5-ec3ce3889d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387ac7ee-3f22-4914-b340-f5bee91b97f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387ac7ee-3f22-4914-b340-f5bee91b97f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275', 'volume_name': 'volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc8570-00fe-496b-86a7-6404f1e39594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc8570-00fe-496b-86a7-6404f1e39594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b226ce69-a97a-4199-93e3-458c84750798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Volume 3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275', 'volume_size': 1}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (6c616604-02ae-4d50-aea0-857fbea33d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3179e022-b1dc-4aab-8a00-ea3c809fed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3179e022-b1dc-4aab-8a00-ea3c809fed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1575542992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff917c95-bb0d-4965-80b7-4a99110a6100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:31Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c21110-1d96-4974-92d6-dd2af8d5a99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c21110-1d96-4974-92d6-dd2af8d5a99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750ff50d-eb95-4ffc-ba42-d4597e075899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750ff50d-eb95-4ffc-ba42-d4597e075899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff917c95-bb0d-4965-80b7-4a99110a6100', 'volume_name': 'volume-ff917c95-bb0d-4965-80b7-4a99110a6100', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9162654-4122-4da8-98cd-39836190b4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9162654-4122-4da8-98cd-39836190b4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a129c9-1bdd-487a-98fe-38339c38ec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Volume ff917c95-bb0d-4965-80b7-4a99110a6100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff917c95-bb0d-4965-80b7-4a99110a6100', 'volume_size': 1}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:31 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af 1073741824" returned: 0 in 0.833s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:31 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af
Aug 29 13:21:31 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:31 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af" returned: 0 in 0.309s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-64124149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d2a263-a359-4cc4-91e5-fadcd4f828cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:30Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Creating volume 64d2a263-a359-4cc4-91e5-fadcd4f828cb {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:31 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:31 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb 1073741824
Aug 29 13:21:31 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31451fa-d58c-4ef0-a278-5cac5f01708b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37d0e3f-d262-474f-af6c-46071c38934d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:31 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Volume volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af (9ce73210-cd30-4e1a-b0df-eb27cc10c9af): created successfully
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37d0e3f-d262-474f-af6c-46071c38934d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:31 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (81da71a8-6fcc-4629-82f3-3f64b27b07f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:31 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-611c7901-de07-4fa6-89b2-948c4327e046 tempest-CreateVolumesFromImageTest-1951201129 None] Created volume successfully.
Aug 29 13:21:32 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb 1073741824" returned: 0 in 0.577s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:32 devstack sudo[99655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb
Aug 29 13:21:32 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:32 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb" returned: 0 in 0.267s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b5fcaf41-d25f-46c3-90a0-370d484463f2,created_at=2026-08-29T11:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-286506904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5fcaf41-d25f-46c3-90a0-370d484463f2,host='devstack@QuobyteHD#QuobyteHD',id=b3e77408-346e-4af1-9dca-c38b2f379ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ca2b53aa6a45cf92a073e6161a26eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:31Z,use_quota=True,user_id='8a69566e6ec746beaed295ff96fad22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dee789-b219-4cf7-8bc9-541b15695aee),volume_type_id=79dee789-b219-4cf7-8bc9-541b15695aee)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Creating volume b3e77408-346e-4af1-9dca-c38b2f379ea2 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:32 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15109d4c-f2e4-4db0-bbdd-dc215d56f093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:32 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2 1073741824
Aug 29 13:21:32 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bca952-c7c5-4745-860c-3f55fc253805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:32 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Volume volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb (64d2a263-a359-4cc4-91e5-fadcd4f828cb): created successfully
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bca952-c7c5-4745-860c-3f55fc253805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (13f307e7-cb0c-44b6-b554-e05c1a33b0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7b13e2bd-0fcf-49fa-86e3-23ba750d5687 tempest-CreateVolumesFromImageTest-1951201129 None] Created volume successfully.
Aug 29 13:21:33 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2 1073741824" returned: 0 in 0.604s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:33 devstack sudo[99665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2
Aug 29 13:21:33 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:33 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.335s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165064692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:31Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Creating volume 3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:33 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:33 devstack sudo[99668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275 1073741824
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafc1ae9-77bf-45d1-8c68-fca5ff421f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e77408-346e-4af1-9dca-c38b2f379ea2', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:33 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4009e7-8bb5-403f-b744-a7ac4d13e48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:33 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Volume volume-b3e77408-346e-4af1-9dca-c38b2f379ea2 (b3e77408-346e-4af1-9dca-c38b2f379ea2): created successfully
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4009e7-8bb5-403f-b744-a7ac4d13e48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Flow 'volume_create_manager' (0957516d-e1ad-4727-8eed-51f882e9eab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:33 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-57a9d58a-8bfb-4143-aa79-1a6fb5aea480 tempest-GroupsTest-909989702 None] Created volume successfully.
Aug 29 13:21:34 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275 1073741824" returned: 0 in 0.728s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:34 devstack sudo[99684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275
Aug 29 13:21:34 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5addafde-c31f-4fde-8011-2b14a64ef502 tempest-GroupsTest-909989702 None] Update group completed successfully.
Aug 29 13:21:34 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275" returned: 0 in 0.347s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.402s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1575542992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff917c95-bb0d-4965-80b7-4a99110a6100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c4b59ccce848b7870aa8dcc905c1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:31Z,use_quota=True,user_id='e361c0cced0d447593b130131a6e82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Creating volume ff917c95-bb0d-4965-80b7-4a99110a6100 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:34 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b226ce69-a97a-4199-93e3-458c84750798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:34 devstack sudo[99689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100 1073741824
Aug 29 13:21:34 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba8d30a-0527-4cb7-879d-faf538ea0842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:34 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Volume volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275 (3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275): created successfully
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba8d30a-0527-4cb7-879d-faf538ea0842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (bb575d0b-c75a-4dae-bcd2-f3dd05f8bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a5c50ba6-be65-46ce-9069-aa38d29f69e1 tempest-CreateVolumesFromImageTest-1951201129 None] Created volume successfully.
Aug 29 13:21:35 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100 1073741824" returned: 0 in 0.503s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:35 devstack sudo[99695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100
Aug 29 13:21:35 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:35 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100" returned: 0 in 0.299s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:21:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a129c9-1bdd-487a-98fe-38339c38ec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff917c95-bb0d-4965-80b7-4a99110a6100', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bb3161-4dd9-4f15-893e-aee399a6c1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:35 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Volume volume-ff917c95-bb0d-4965-80b7-4a99110a6100 (ff917c95-bb0d-4965-80b7-4a99110a6100): created successfully
Aug 29 13:21:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bb3161-4dd9-4f15-893e-aee399a6c1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Flow 'volume_create_manager' (6c616604-02ae-4d50-aea0-857fbea33d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:35 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b0252077-f8cf-4a85-89e9-81f6eded58b8 tempest-CreateVolumesFromImageTest-1951201129 None] Created volume successfully.
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Flow 'volume_create_manager' (427983f7-21c4-4860-ab1b-0642d6d28951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5599be8-5967-4c7f-9db2-1538a4053563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5599be8-5967-4c7f-9db2-1538a4053563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-489339445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b7b452-eacf-4256-a5c3-4fcf84d50fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa700fabc834eed861b690eda694d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e120c9c5-1d28-4afc-8150-8b3cdeb2fbde,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:21:36Z,use_quota=True,user_id='e47ff6655851427ab1f71b3bfdcd0ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c967bb2-e1c1-4459-a5ae-96535133442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c967bb2-e1c1-4459-a5ae-96535133442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6537611a-81f1-49bf-812a-d15ee5cecec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6537611a-81f1-49bf-812a-d15ee5cecec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3b7b452-eacf-4256-a5c3-4fcf84d50fdf', 'volume_name': 'volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf', 'volume_size': 1, 'snapshot_id': 'e120c9c5-1d28-4afc-8150-8b3cdeb2fbde'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45540b43-66be-4c36-9efd-3a3f3153d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45540b43-66be-4c36-9efd-3a3f3153d49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6edf17-32d6-481a-93a2-73eea3581bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:36 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Volume b3b7b452-eacf-4256-a5c3-4fcf84d50fdf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf', 'volume_size': 1, 'snapshot_id': 'e120c9c5-1d28-4afc-8150-8b3cdeb2fbde'}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Acquiring lock "cinder-quobyte-e120c9c5-1d28-4afc-8150-8b3cdeb2fbde-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" by "_create_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:36 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-df41bf05-e5ab-4847-926e-6cbbccbd5e3a tempest-GroupsTest-909989702 None] Update group completed successfully.
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-e120c9c5-1d28-4afc-8150-8b3cdeb2fbde-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Creating volume b3b7b452-eacf-4256-a5c3-4fcf84d50fdf from snapshot e120c9c5-1d28-4afc-8150-8b3cdeb2fbde {{(pid=85771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Acquiring lock "cinder-quobyte-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] snapshot: e120c9c5-1d28-4afc-8150-8b3cdeb2fbde, volume: b3b7b452-eacf-4256-a5c3-4fcf84d50fdf,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[09866512-7f8c-44b0-9f0f-42941810c474]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:36 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde
Aug 29 13:21:36 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:36 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde" returned: 0 in 0.391s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40e56b36-0258-47ed-9265-627189a7fec4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[098bd680-a0c4-4f39-831e-d9a3eb0a4f25]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-ff917c95-bb0d-4965-80b7-4a99110a6100-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-ff917c95-bb0d-4965-80b7-4a99110a6100-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-quobyte-ff917c95-bb0d-4965-80b7-4a99110a6100" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-ff917c95-bb0d-4965-80b7-4a99110a6100" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:36 devstack sudo[99731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4
Aug 29 13:21:36 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8070cf-a13b-4dbc-b91a-d5ae6a2c209a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:37 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100
Aug 29 13:21:37 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:37 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4" returned: 0 in 0.492s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:37 devstack sudo[99741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf
Aug 29 13:21:37 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:37 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100" returned: 0 in 0.448s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:37 devstack sudo[99746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100
Aug 29 13:21:37 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:37 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ff917c95-bb0d-4965-80b7-4a99110a6100" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-ff917c95-bb0d-4965-80b7-4a99110a6100" released by "delete_volume" :: held 0.837s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Created reservations ['440d171e-9275-488c-a2ce-4fc64c9cbadb', 'f1fc7c2b-2340-4e2a-9b50-99ba3ab064c9', 'ba0e6412-58e9-48b7-b6c1-c6e5246db3c3', '4cedc899-9055-40cd-ac8a-1718e3b6fe39'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:37 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:37 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Acquiring lock "cinder-quobyte-1fa1720b-6b3f-4614-b205-2d023581473e" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Lock "cinder-quobyte-1fa1720b-6b3f-4614-b205-2d023581473e" acquired by "delete_volume" :: waited 0.101s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c7d7af-828d-4c2b-a723-83c7d28583ee]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-quobyte-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275" acquired by "delete_volume" :: waited 0.035s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:38 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.751s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f07e5e7-d024-43bc-b9ad-b1281eed9ef8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Deleted volume successfully.
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f890518-8d31-4ea9-8459-afa241b3d632 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-ff917c95-bb0d-4965-80b7-4a99110a6100-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:38 devstack sudo[99762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e
Aug 29 13:21:38 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:38 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275
Aug 29 13:21:38 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:39 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e" returned: 0 in 1.017s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:39 devstack sudo[99771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e
Aug 29 13:21:39 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:39 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275" returned: 0 in 1.045s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:39 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275
Aug 29 13:21:39 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:40 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1fa1720b-6b3f-4614-b205-2d023581473e" returned: 0 in 0.834s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Lock "cinder-quobyte-1fa1720b-6b3f-4614-b205-2d023581473e" released by "delete_volume" :: held 2.043s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Acquiring lock "cinder-quobyte-b3e77408-346e-4af1-9dca-c38b2f379ea2" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Lock "cinder-quobyte-b3e77408-346e-4af1-9dca-c38b2f379ea2" acquired by "delete_volume" :: waited 0.039s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:40 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa26643-64fb-43bf-8c3e-ec4cfcffef1d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:40 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275" returned: 0 in 0.878s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275" released by "delete_volume" :: held 2.066s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:40 devstack sudo[99781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2
Aug 29 13:21:40 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:40 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Created reservations ['4952cfd6-3b26-4b30-b2f6-65e8859476a6', '45c8a937-2057-4b54-971d-ae02ac8402eb', 'df96ea43-f4c2-4bb1-897a-2ad2a403e634', '43be2121-62bc-4cec-8178-3c1dc5f2f859'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:41 devstack sudo[99787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:41 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:41 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2" returned: 0 in 1.272s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:41 devstack sudo[99793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2
Aug 29 13:21:41 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:41 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.778s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Deleted volume successfully.
Aug 29 13:21:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-eed0321c-fea5-404f-a206-45af51ea8475 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-3d0ba554-8e2c-49b5-b6bd-d37e1b2b5275-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:42 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3e77408-346e-4af1-9dca-c38b2f379ea2" returned: 0 in 0.598s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-64d2a263-a359-4cc4-91e5-fadcd4f828cb-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Lock "cinder-quobyte-b3e77408-346e-4af1-9dca-c38b2f379ea2" released by "delete_volume" :: held 2.072s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-64d2a263-a359-4cc4-91e5-fadcd4f828cb-delete_volume" acquired by "delete_volume" :: waited 0.162s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-quobyte-64d2a263-a359-4cc4-91e5-fadcd4f828cb" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-64d2a263-a359-4cc4-91e5-fadcd4f828cb" acquired by "delete_volume" :: waited 0.044s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:42 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb5f894-dadb-4d43-bf12-e1b77c969070]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:42 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Created reservations ['afe47914-785b-4f09-b87f-bf12dbc08ace'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:43 devstack sudo[99796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb
Aug 29 13:21:43 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:43 devstack cinder-volume[85771]: WARNING cinder.quota [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1699427275 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1699427275, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:21:43 devstack cinder-volume[85771]: WARNING cinder.quota [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1699427275 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1699427275, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:21:43 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Created reservations ['b7899ef7-165e-41ae-b627-152da1a27fe1', 'ad5dcfa5-e77f-4423-8a17-000be6b747c8', '1548280c-eb9b-4571-a2fe-c8baeaa9c93d', 'd6eff08c-dae9-47e8-b1b0-246c58c3792f'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:43 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Created reservations ['b15488eb-9128-47cb-9671-c3a6b618bc02', '2bcad403-8fdc-4fc3-b4d9-674de5b2e237', '49be10e4-2e71-4fdc-8488-9f7dbc14a846', '5c7aca3c-2319-45d4-904a-8941c5dcf827'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:44 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb" returned: 0 in 1.290s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:44 devstack sudo[99802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:44 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:44 devstack sudo[99804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:44 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:44 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-64d2a263-a359-4cc4-91e5-fadcd4f828cb" returned: 0 in 0.689s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-64d2a263-a359-4cc4-91e5-fadcd4f828cb" released by "delete_volume" :: held 2.152s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Created reservations ['ff27f2de-744b-40e4-9012-27b59a531f35', 'f4fd7692-956d-4b83-a21e-8ba15e4c0a2b', 'c8e17b51-1038-4c0b-94ca-7c9b34b3c1e2', '8a1abebc-8774-46f0-90d5-ae10434d1f6a'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:45 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.966s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1a584c79-af9d-444f-899c-f32c9582cc61 tempest-GroupsTest-909989702 None] Delete group completed successfully.
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:45 devstack sudo[99817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:45 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:45 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" returned: 0 in 8.281s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:21:45 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Converted 1024.00 MB image at 123.64 MB/s
Aug 29 13:21:45 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf is being set with open permissions: ugo+rw
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:45 devstack sudo[99820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf
Aug 29 13:21:45 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:45 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.468s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Deleted volume successfully.
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-45831fde-cbed-4f6b-be65-cf3ca01a78ad tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-64d2a263-a359-4cc4-91e5-fadcd4f828cb-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:45 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" returned: 0 in 0.415s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" released by "_copy_volume_from_snapshot" :: held 9.681s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-e120c9c5-1d28-4afc-8150-8b3cdeb2fbde-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" released by "_create_volume_from_snapshot" :: held 9.784s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.806s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6edf17-32d6-481a-93a2-73eea3581bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf', 'volume_size': 1, 'snapshot_id': 'e120c9c5-1d28-4afc-8150-8b3cdeb2fbde'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230b086b-3208-49a1-93a6-a57190598f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:21:46 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Volume volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf (b3b7b452-eacf-4256-a5c3-4fcf84d50fdf): created successfully
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230b086b-3208-49a1-93a6-a57190598f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Flow 'volume_create_manager' (427983f7-21c4-4860-ab1b-0642d6d28951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:21:46 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ef27973d-137d-4f49-a7d4-f31fdb67c72b tempest-TestStampPattern-1653392327 None] Created volume successfully.
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-9ce73210-cd30-4e1a-b0df-eb27cc10c9af-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-9ce73210-cd30-4e1a-b0df-eb27cc10c9af-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-quobyte-9ce73210-cd30-4e1a-b0df-eb27cc10c9af" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-9ce73210-cd30-4e1a-b0df-eb27cc10c9af" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57c0543-d5e0-4a5d-ad00-66d62784d44e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:46 devstack sudo[99851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af
Aug 29 13:21:46 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:46 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af" returned: 0 in 0.545s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:46 devstack sudo[99862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af
Aug 29 13:21:47 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:47 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9ce73210-cd30-4e1a-b0df-eb27cc10c9af" returned: 0 in 0.470s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-9ce73210-cd30-4e1a-b0df-eb27cc10c9af" released by "delete_volume" :: held 1.101s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:47 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Created reservations ['27deca06-62da-495f-b2b9-a0bd81dc829d', 'de0fef7a-641d-477b-94c8-15e92fc7eba1', '9fbf69df-879b-4eff-b9be-ac8517a18a5d', 'ac9685be-fbff-4a93-ab22-97984c58cde9'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:47 devstack sudo[99870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:47 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:48 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.529s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:48 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:48 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Deleted volume successfully.
Aug 29 13:21:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ac55a6e7-288b-4b01-8dba-28b8ac99948b tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-9ce73210-cd30-4e1a-b0df-eb27cc10c9af-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-c8e726d5-2712-468d-b4a0-ac0deccc5b9f-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-c8e726d5-2712-468d-b4a0-ac0deccc5b9f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "cinder-quobyte-c8e726d5-2712-468d-b4a0-ac0deccc5b9f" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:21:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-c8e726d5-2712-468d-b4a0-ac0deccc5b9f" acquired by "delete_volume" :: waited 0.043s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:21:48 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f752f-3ac6-43d1-bb7d-dde7d3a3feaa]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:21:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:49 devstack sudo[99911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f
Aug 29 13:21:49 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:49 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f" returned: 0 in 0.546s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:49 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f
Aug 29 13:21:49 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:49 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8e726d5-2712-468d-b4a0-ac0deccc5b9f" returned: 0 in 0.536s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-quobyte-c8e726d5-2712-468d-b4a0-ac0deccc5b9f" released by "delete_volume" :: held 1.192s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Created reservations ['deb2f5ad-9303-436e-934b-543e3e7e9777', 'eb7f98c7-fdcb-45a8-886e-1c3422829736', '28f56c04-9ee4-4e75-bf85-afb6dec03f64', 'b51d9ebc-fb4f-448d-9173-c61af5c33edb'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:50 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:50 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:50 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.377s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:50 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Deleted volume successfully.
Aug 29 13:21:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ae844ee6-a1fa-442f-9777-cd0038975213 tempest-CreateVolumesFromImageTest-1951201129 None] Lock "cinder-c8e726d5-2712-468d-b4a0-ac0deccc5b9f-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:21:52 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-4bd94e0d-d963-4dc2-89a2-6e9886b45899 req-b8f4370a-10a4-43c3-8af9-1eb2903e01f7 tempest-TestShelveInstance-1250222549 None] Terminate volume connection completed successfully.
Aug 29 13:21:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-4bd94e0d-d963-4dc2-89a2-6e9886b45899 req-b8f4370a-10a4-43c3-8af9-1eb2903e01f7 tempest-TestShelveInstance-1250222549 None] Deleting attachment 63f2cccd-b50c-405f-b08a-530d0e925dcf. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:21:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:21:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:21:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:21:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:21:54 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:21:54 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:21:54 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Aug 29 13:21:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.365s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:21:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:21:55 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:21:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:21:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:21:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-031ad915-87f7-41ee-a106-57cc6d300df1 req-36fc19d1-096a-465d-8dc7-e950ba924ca4 tempest-TestShelveInstance-1250222549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:21:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-031ad915-87f7-41ee-a106-57cc6d300df1 req-36fc19d1-096a-465d-8dc7-e950ba924ca4 tempest-TestShelveInstance-1250222549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:21:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-031ad915-87f7-41ee-a106-57cc6d300df1 req-36fc19d1-096a-465d-8dc7-e950ba924ca4 tempest-TestShelveInstance-1250222549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:21:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-031ad915-87f7-41ee-a106-57cc6d300df1 req-36fc19d1-096a-465d-8dc7-e950ba924ca4 tempest-TestShelveInstance-1250222549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-00e29d92-1b84-43c7-8c16-967f74f04d60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9d45b03-57d4-4baa-92f0-abbf7959df2c', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:21:57 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-031ad915-87f7-41ee-a106-57cc6d300df1 req-36fc19d1-096a-465d-8dc7-e950ba924ca4 tempest-TestShelveInstance-1250222549 None] attachment_update completed successfully.
Aug 29 13:22:02 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Flow 'volume_create_manager' (31dd265a-bbd1-4b0b-845e-6b362a0aee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abadd274-012f-4dac-b6e9-ae89c1e023b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abadd274-012f-4dac-b6e9-ae89c1e023b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24608b28-4ed2-4302-9d95-ef2768a56dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2fe88ec611445c9df363efaac9e715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:02Z,use_quota=True,user_id='805d883422344f39b8f2353c494a3ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaec4f04-01f9-4afd-aea6-2c83e2098d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaec4f04-01f9-4afd-aea6-2c83e2098d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ff177e-a4e7-4b43-a561-8246a8ab7af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:02 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:22:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ff177e-a4e7-4b43-a561-8246a8ab7af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24608b28-4ed2-4302-9d95-ef2768a56dd2', 'volume_name': 'volume-24608b28-4ed2-4302-9d95-ef2768a56dd2', 'volume_size': 1, 'image_id': '620a05b9-7d69-4403-864b-35facd34bcaa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/620a05b9-7d69-4403-864b-35facd34bcaa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd5cf54a696aa0c6c96a9f2ad8808f1f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc2fe88ec611445c9df363efaac9e715', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ee5f020fc97bfef3b2a6b2b27cda72b337249ae091b41e04467eb0d22653183e587f9cccc947a2d49e2df33eed46f386cacc262c1a6898e8a1b4d94c4064434', 'id': '620a05b9-7d69-4403-864b-35facd34bcaa', 'created_at': datetime.datetime(2026, 8, 29, 11, 21, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/620a05b9-7d69-4403-864b-35facd34bcaa/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6165aebd0>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc5f05a-128f-4bec-a387-f612929d5581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc5f05a-128f-4bec-a387-f612929d5581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3140190-31dd-41f4-97b8-246fc8dc5468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:03 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Volume 24608b28-4ed2-4302-9d95-ef2768a56dd2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24608b28-4ed2-4302-9d95-ef2768a56dd2', 'volume_size': 1, 'image_id': '620a05b9-7d69-4403-864b-35facd34bcaa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/620a05b9-7d69-4403-864b-35facd34bcaa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd5cf54a696aa0c6c96a9f2ad8808f1f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc2fe88ec611445c9df363efaac9e715', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ee5f020fc97bfef3b2a6b2b27cda72b337249ae091b41e04467eb0d22653183e587f9cccc947a2d49e2df33eed46f386cacc262c1a6898e8a1b4d94c4064434', 'id': '620a05b9-7d69-4403-864b-35facd34bcaa', 'created_at': datetime.datetime(2026, 8, 29, 11, 21, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/620a05b9-7d69-4403-864b-35facd34bcaa/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6165aebd0>}
Aug 29 13:22:03 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Trying to clone 24608b28-4ed2-4302-9d95-ef2768a56dd2 from image 620a05b9-7d69-4403-864b-35facd34bcaa at location (None, [{'url': 'file:///opt/stack/data/glance/images/620a05b9-7d69-4403-864b-35facd34bcaa', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:22:03 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:22:03 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Image download 0.00 MB at 0.00 MB/s
Aug 29 13:22:03 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1761562c-960e-4585-b44d-779f625b8b97]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:03 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD
Aug 29 13:22:03 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:04 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD" returned: 0 in 0.767s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:04 devstack sudo[100421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD
Aug 29 13:22:04 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:04 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD" returned: 1 in 0.643s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:22:04 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Temporary image 620a05b9-7d69-4403-864b-35facd34bcaa is fetched for user 805d883422344f39b8f2353c494a3ed6. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:22:05 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30eaced-2420-4d55-94f6-3ac3cf6c0d7e]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:05 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD
Aug 29 13:22:05 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:05 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD" returned: 0 in 0.521s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:05 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD
Aug 29 13:22:05 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:06 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD" returned: 1 in 0.437s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24608b28-4ed2-4302-9d95-ef2768a56dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2fe88ec611445c9df363efaac9e715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:02Z,use_quota=True,user_id='805d883422344f39b8f2353c494a3ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Creating volume 24608b28-4ed2-4302-9d95-ef2768a56dd2 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:06 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:06 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 1073741824
Aug 29 13:22:06 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:06 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 1073741824" returned: 0 in 0.573s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:06 devstack sudo[100444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2
Aug 29 13:22:06 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Flow 'volume_create_manager' (4fd82824-91e0-4479-8609-b7f30a97437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026d92a3-17b3-4b53-91dd-81dc1b70f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026d92a3-17b3-4b53-91dd-81dc1b70f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-956597274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3d4a28-8575-48e3-b107-b267cbbad738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af1428470a2441ab6fe95455d56aa4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:07Z,use_quota=True,user_id='9b6a32deb45b478fa85e41fc92444775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e94e36-9686-4685-811e-5ae025d5704f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e94e36-9686-4685-811e-5ae025d5704f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244fab65-93fc-4a53-b50a-87c097107dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244fab65-93fc-4a53-b50a-87c097107dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3d4a28-8575-48e3-b107-b267cbbad738', 'volume_name': 'volume-ab3d4a28-8575-48e3-b107-b267cbbad738', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d45d4b-d63c-4163-b823-7b9fb42fbaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d45d4b-d63c-4163-b823-7b9fb42fbaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff1b3df-8d62-4b55-9548-0629057b75eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:06 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Volume ab3d4a28-8575-48e3-b107-b267cbbad738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3d4a28-8575-48e3-b107-b267cbbad738', 'volume_size': 1}
Aug 29 13:22:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:07 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2" returned: 0 in 0.297s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.059s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-956597274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3d4a28-8575-48e3-b107-b267cbbad738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af1428470a2441ab6fe95455d56aa4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:07Z,use_quota=True,user_id='9b6a32deb45b478fa85e41fc92444775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Creating volume ab3d4a28-8575-48e3-b107-b267cbbad738 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:07 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:07 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738 1073741824
Aug 29 13:22:07 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Attempting download of 620a05b9-7d69-4403-864b-35facd34bcaa ((None, [{'url': 'file:///opt/stack/data/glance/images/620a05b9-7d69-4403-864b-35facd34bcaa', 'metadata': {}}])) to volume 24608b28-4ed2-4302-9d95-ef2768a56dd2. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb053d-d53e-4909-9304-59f46c17078e]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_620a05b9-7d69-4403-864b-35facd34bcaa_7tbjvzrq {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:07 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_620a05b9-7d69-4403-864b-35facd34bcaa_7tbjvzrq
Aug 29 13:22:07 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:07 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_620a05b9-7d69-4403-864b-35facd34bcaa_7tbjvzrq" returned: 0 in 0.363s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_620a05b9-7d69-4403-864b-35facd34bcaa_7tbjvzrq {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:07 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738 1073741824" returned: 0 in 0.515s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:07 devstack sudo[100458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738
Aug 29 13:22:07 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:07 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_620a05b9-7d69-4403-864b-35facd34bcaa_7tbjvzrq
Aug 29 13:22:07 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:07 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738" returned: 0 in 0.275s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff1b3df-8d62-4b55-9548-0629057b75eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3d4a28-8575-48e3-b107-b267cbbad738', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:07 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d12a9e-0bd7-412b-b245-06d220415827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_620a05b9-7d69-4403-864b-35facd34bcaa_7tbjvzrq" returned: 1 in 0.396s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_620a05b9-7d69-4403-864b-35facd34bcaa_7tbjvzrq' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ba9596-6596-499e-8b38-57d08afd0796]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:07 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Volume volume-ab3d4a28-8575-48e3-b107-b267cbbad738 (ab3d4a28-8575-48e3-b107-b267cbbad738): created successfully
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d12a9e-0bd7-412b-b245-06d220415827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Flow 'volume_create_manager' (4fd82824-91e0-4479-8609-b7f30a97437b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-24a8577c-7801-4a9b-a699-92bb34f23c3a tempest-VolumeQuotasAdminTestJSON-904491205 None] Created volume successfully.
Aug 29 13:22:08 devstack sudo[100464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD
Aug 29 13:22:08 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:08 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:08 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD
Aug 29 13:22:08 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:08 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD" returned: 1 in 0.366s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:22:08 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] 620a05b9-7d69-4403-864b-35facd34bcaa was raw, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:22:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:08 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2
Aug 29 13:22:08 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Acquiring lock "cinder-ab3d4a28-8575-48e3-b107-b267cbbad738-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "cinder-ab3d4a28-8575-48e3-b107-b267cbbad738-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Acquiring lock "cinder-quobyte-ab3d4a28-8575-48e3-b107-b267cbbad738" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:09 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2" returned: 0 in 0.578s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "cinder-quobyte-ab3d4a28-8575-48e3-b107-b267cbbad738" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_620a05b9-7d69-4403-864b-35facd34bcaa_illqxv75devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:22:09 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Converted 0.00 MB image at 0.00 MB/s
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7f2065-afea-451d-b610-7d8b4fa6474a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:09 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 1G
Aug 29 13:22:09 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:09 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738
Aug 29 13:22:09 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:09 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 1G" returned: 0 in 0.320s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Downloaded image 620a05b9-7d69-4403-864b-35facd34bcaa ((None, [{'url': 'file:///opt/stack/data/glance/images/620a05b9-7d69-4403-864b-35facd34bcaa', 'metadata': {}}])) to volume 24608b28-4ed2-4302-9d95-ef2768a56dd2 successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Temporary image 620a05b9-7d69-4403-864b-35facd34bcaa for user 805d883422344f39b8f2353c494a3ed6 is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Marking volume 24608b28-4ed2-4302-9d95-ef2768a56dd2 as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Copying metadata from image 620a05b9-7d69-4403-864b-35facd34bcaa to 24608b28-4ed2-4302-9d95-ef2768a56dd2. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Creating volume glance metadata for volume 24608b28-4ed2-4302-9d95-ef2768a56dd2 backed by image 620a05b9-7d69-4403-864b-35facd34bcaa with: {'image_id': '620a05b9-7d69-4403-864b-35facd34bcaa', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd5cf54a696aa0c6c96a9f2ad8808f1f0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3140190-31dd-41f4-97b8-246fc8dc5468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24608b28-4ed2-4302-9d95-ef2768a56dd2', 'volume_size': 1, 'image_id': '620a05b9-7d69-4403-864b-35facd34bcaa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/620a05b9-7d69-4403-864b-35facd34bcaa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd5cf54a696aa0c6c96a9f2ad8808f1f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc2fe88ec611445c9df363efaac9e715', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ee5f020fc97bfef3b2a6b2b27cda72b337249ae091b41e04467eb0d22653183e587f9cccc947a2d49e2df33eed46f386cacc262c1a6898e8a1b4d94c4064434', 'id': '620a05b9-7d69-4403-864b-35facd34bcaa', 'created_at': datetime.datetime(2026, 8, 29, 11, 21, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/620a05b9-7d69-4403-864b-35facd34bcaa/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6165aebd0>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce045fd-62af-44b3-a990-a4ca5b6f5af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:09 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738" returned: 0 in 0.441s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:09 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Volume volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 (24608b28-4ed2-4302-9d95-ef2768a56dd2): created successfully
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce045fd-62af-44b3-a990-a4ca5b6f5af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Flow 'volume_create_manager' (31dd265a-bbd1-4b0b-845e-6b362a0aee6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:09 devstack sudo[100489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738
Aug 29 13:22:09 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4dff9038-8981-4ae9-bf38-afcf96c59a54 tempest-VolumeImageDependencyTests-216600020 None] Created volume successfully.
Aug 29 13:22:09 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ab3d4a28-8575-48e3-b107-b267cbbad738" returned: 0 in 0.264s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "cinder-quobyte-ab3d4a28-8575-48e3-b107-b267cbbad738" released by "delete_volume" :: held 0.752s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:09 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Created reservations ['4e74c856-285b-424c-aaf9-b99e03d03251', '74f93514-a92c-48e8-9d64-113e8eb5e639', '0b1be8ae-7e34-42b5-9e3a-139dbdda7dc5', '1ee21a44-eee8-4f0a-9cf9-1affe2cf5139'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:10 devstack sudo[100492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:10 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:10 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.272s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Deleted volume successfully.
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c39a5c8a-e152-40ec-8928-db80bd672849 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "cinder-ab3d4a28-8575-48e3-b107-b267cbbad738-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Flow 'volume_create_manager' (f3df6a50-6e51-415f-bb9b-1c561905b618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f975ba34-a2f7-4601-b39c-679303653fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f975ba34-a2f7-4601-b39c-679303653fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1151587639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503d260a-5bcf-4cc7-8702-101cdbb89005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af1428470a2441ab6fe95455d56aa4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:11Z,use_quota=True,user_id='9b6a32deb45b478fa85e41fc92444775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dde38c-7627-4049-a8b6-a78930df337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dde38c-7627-4049-a8b6-a78930df337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd594e3a-0013-498b-b566-90147c0a6898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd594e3a-0013-498b-b566-90147c0a6898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503d260a-5bcf-4cc7-8702-101cdbb89005', 'volume_name': 'volume-503d260a-5bcf-4cc7-8702-101cdbb89005', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7048c70-31d2-4ae2-b23b-93aa50aabd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7048c70-31d2-4ae2-b23b-93aa50aabd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec4a546-ada8-441e-bc44-50ee2839675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:10 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Volume 503d260a-5bcf-4cc7-8702-101cdbb89005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503d260a-5bcf-4cc7-8702-101cdbb89005', 'volume_size': 1}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1151587639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503d260a-5bcf-4cc7-8702-101cdbb89005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af1428470a2441ab6fe95455d56aa4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:11Z,use_quota=True,user_id='9b6a32deb45b478fa85e41fc92444775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Creating volume 503d260a-5bcf-4cc7-8702-101cdbb89005 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:10 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:10 devstack sudo[100495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005 1073741824
Aug 29 13:22:10 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Acquiring lock "cinder-24608b28-4ed2-4302-9d95-ef2768a56dd2-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Lock "cinder-24608b28-4ed2-4302-9d95-ef2768a56dd2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Acquiring lock "cinder-quobyte-24608b28-4ed2-4302-9d95-ef2768a56dd2" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Lock "cinder-quobyte-24608b28-4ed2-4302-9d95-ef2768a56dd2" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e09c0f-e0be-4455-8721-9e9f72dbe6a6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:11 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2
Aug 29 13:22:11 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:11 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005 1073741824" returned: 0 in 0.472s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:11 devstack sudo[100504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005
Aug 29 13:22:11 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:11 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2" returned: 0 in 0.425s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:11 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2
Aug 29 13:22:11 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:11 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005" returned: 0 in 0.257s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec4a546-ada8-441e-bc44-50ee2839675a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503d260a-5bcf-4cc7-8702-101cdbb89005', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2074718-f328-413e-a552-0fef235e445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:11 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Volume volume-503d260a-5bcf-4cc7-8702-101cdbb89005 (503d260a-5bcf-4cc7-8702-101cdbb89005): created successfully
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2074718-f328-413e-a552-0fef235e445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Flow 'volume_create_manager' (f3df6a50-6e51-415f-bb9b-1c561905b618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:11 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:11 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f234a422-8379-4f51-bde3-0af3d88f2a57 tempest-VolumeQuotasAdminTestJSON-904491205 None] Created volume successfully.
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-24608b28-4ed2-4302-9d95-ef2768a56dd2" returned: 0 in 0.291s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Lock "cinder-quobyte-24608b28-4ed2-4302-9d95-ef2768a56dd2" released by "delete_volume" :: held 0.765s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Created reservations ['f3c1a802-b6c6-44fa-9d69-e3f2f7d645cf', '08295237-1dab-46bc-8c78-c7bedf3a6b31', 'ff47d130-200c-48a9-8b74-ac050416f4e1', '96e83e3a-a059-40cd-aeb2-ab77f7348099'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:11 devstack sudo[100511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:11 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:12 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.286s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:12 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Deleted volume successfully.
Aug 29 13:22:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-df8f79ca-ed56-4f2a-b5cf-d0a163e5f3fd tempest-VolumeImageDependencyTests-216600020 None] Lock "cinder-24608b28-4ed2-4302-9d95-ef2768a56dd2-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1b8a3571-a377-4aa6-a190-eabbbb902dc2 tempest-VolumeQuotasAdminTestJSON-1228660034 None] Transfer volume completed successfully.
Aug 29 13:22:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Acquiring lock "cinder-503d260a-5bcf-4cc7-8702-101cdbb89005-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Lock "cinder-503d260a-5bcf-4cc7-8702-101cdbb89005-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=133,cinder:UPDATE=152,cinder:DELETE=12,cinder:INSERT=38 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:22:14 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=128,cinder:UPDATE=161,cinder:INSERT=39,cinder:DELETE=11 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:22:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Acquiring lock "cinder-quobyte-503d260a-5bcf-4cc7-8702-101cdbb89005" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Lock "cinder-quobyte-503d260a-5bcf-4cc7-8702-101cdbb89005" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:14 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2f3e3d-98ed-4116-9aab-dc1a15100396]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:15 devstack sudo[100519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005
Aug 29 13:22:15 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:15 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005" returned: 0 in 0.577s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:15 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005
Aug 29 13:22:15 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:15 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-503d260a-5bcf-4cc7-8702-101cdbb89005" returned: 0 in 0.296s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Lock "cinder-quobyte-503d260a-5bcf-4cc7-8702-101cdbb89005" released by "delete_volume" :: held 0.966s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:15 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Created reservations ['3d3b231f-f9b4-482c-bb0c-1efabd2374d1', '89fb5968-99cb-4699-8d46-b4dee368666e', 'd97cd4ec-cc51-4507-a20a-ed4ffff0847d', '5edc98aa-42f2-4845-8c8b-40d758e276e6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:16 devstack sudo[100532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:16 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:16 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.362s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Deleted volume successfully.
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bc5a056d-00f3-474c-80be-792ec39c3f21 tempest-VolumeQuotasAdminTestJSON-301147276 None] Lock "cinder-503d260a-5bcf-4cc7-8702-101cdbb89005-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-7fd4fcf0-3fd8-42ed-8ba6-83e35e334bb0 req-f84c22bf-349b-406c-a6fe-816e46d2f704 tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-7fd4fcf0-3fd8-42ed-8ba6-83e35e334bb0 req-f84c22bf-349b-406c-a6fe-816e46d2f704 tempest-TestStampPattern-1653392327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-7fd4fcf0-3fd8-42ed-8ba6-83e35e334bb0 req-f84c22bf-349b-406c-a6fe-816e46d2f704 tempest-TestStampPattern-1653392327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-7fd4fcf0-3fd8-42ed-8ba6-83e35e334bb0 req-f84c22bf-349b-406c-a6fe-816e46d2f704 tempest-TestStampPattern-1653392327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40500852-a332-4c52-a778-b02311e5fb71', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:22:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-7fd4fcf0-3fd8-42ed-8ba6-83e35e334bb0 req-f84c22bf-349b-406c-a6fe-816e46d2f704 tempest-TestStampPattern-1653392327 None] attachment_update completed successfully.
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Flow 'volume_create_manager' (0d0024f7-e283-42d6-86cc-6e2cfd62f0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e567fdd-c649-4f20-a7a6-6369033dc844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e567fdd-c649-4f20-a7a6-6369033dc844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1873197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3be7d3e5c65411696af134d84bb19ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:17Z,use_quota=True,user_id='57820fd527c8464f98b51c416c00159e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0495eecc-e9bf-4a07-a84a-d33137b20f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0495eecc-e9bf-4a07-a84a-d33137b20f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed331d9-ae1a-4d9f-85d5-eb710015fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed331d9-ae1a-4d9f-85d5-eb710015fa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0', 'volume_name': 'volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe3f345-2e66-48b0-ae14-7d6cc48a8fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe3f345-2e66-48b0-ae14-7d6cc48a8fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470f4162-0cad-4925-8a77-7d747bf7a72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:17 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Volume 26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0', 'volume_size': 1}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1873197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3be7d3e5c65411696af134d84bb19ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:17Z,use_quota=True,user_id='57820fd527c8464f98b51c416c00159e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Creating volume 26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:17 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:17 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0 1073741824
Aug 29 13:22:17 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:18 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0 1073741824" returned: 0 in 0.583s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:18 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0
Aug 29 13:22:18 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:18 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0" returned: 0 in 0.345s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470f4162-0cad-4925-8a77-7d747bf7a72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728b1586-6915-4908-aea7-0772d1d99403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Volume volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0 (26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0): created successfully
Aug 29 13:22:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728b1586-6915-4908-aea7-0772d1d99403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Flow 'volume_create_manager' (0d0024f7-e283-42d6-86cc-6e2cfd62f0a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b52f698b-fd94-457d-8ef3-ad29618f67a1 tempest-ProjectReaderTests-1530899140 None] Created volume successfully.
Aug 29 13:22:19 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-40dabe1a-3ed4-48af-b846-273c98804aac req-0585ff0c-52f5-4276-aaf3-ad945f2640d6 tempest-TestStampPattern-1653392327 None] Terminate volume connection completed successfully.
Aug 29 13:22:19 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-40dabe1a-3ed4-48af-b846-273c98804aac req-0585ff0c-52f5-4276-aaf3-ad945f2640d6 tempest-TestStampPattern-1653392327 None] Deleting attachment 40500852-a332-4c52-a778-b02311e5fb71. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:22:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Acquiring lock "cinder-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Lock "cinder-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Acquiring lock "cinder-quobyte-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Lock "cinder-quobyte-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:20 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c64e79-5cba-4b96-ad4e-ec5a88fe525b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:20 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0
Aug 29 13:22:20 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:20 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0" returned: 0 in 0.456s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:20 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0
Aug 29 13:22:20 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:20 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0" returned: 0 in 0.304s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:20 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Lock "cinder-quobyte-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0" released by "delete_volume" :: held 0.823s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:20 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Created reservations ['e3ff684e-2795-4b46-8cb9-6b550c5fb9b5', 'a26934e1-2f00-4b3e-a5dc-d3b42595d063', '4e93f79a-07f6-4180-96b1-be6f40d2ee2b', '0bccbf50-fd65-428f-9838-af561ecba27c'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:21 devstack sudo[100588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:21 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:21 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.469s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:21 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Deleted volume successfully.
Aug 29 13:22:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d02e44d5-2053-4ef9-b265-fd044c6f2290 tempest-ProjectReaderTests-1530899140 None] Lock "cinder-26cfea4d-1bc5-490f-a79c-8a4c26ebd7b0-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Flow 'volume_create_manager' (7b27bd8f-7dcf-4217-b85d-0a11164ea695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60afe2f-b353-46dd-a4b7-c5b09df41c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60afe2f-b353-46dd-a4b7-c5b09df41c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540580313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef953dd-65f0-445c-a26e-a76fbe07de8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3be7d3e5c65411696af134d84bb19ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:22Z,use_quota=True,user_id='57820fd527c8464f98b51c416c00159e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa3ef0d-87d3-4a8d-9520-1a0f26c460ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa3ef0d-87d3-4a8d-9520-1a0f26c460ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bc9682-adf9-4a01-a9bd-5c37feecd713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bc9682-adf9-4a01-a9bd-5c37feecd713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef953dd-65f0-445c-a26e-a76fbe07de8e', 'volume_name': 'volume-eef953dd-65f0-445c-a26e-a76fbe07de8e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8894c86-b2cd-406c-9aae-ca967f960577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8894c86-b2cd-406c-9aae-ca967f960577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fea540c-c85c-4d5a-8052-24208d5296a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:22 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Volume eef953dd-65f0-445c-a26e-a76fbe07de8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef953dd-65f0-445c-a26e-a76fbe07de8e', 'volume_size': 1}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540580313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef953dd-65f0-445c-a26e-a76fbe07de8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3be7d3e5c65411696af134d84bb19ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:22Z,use_quota=True,user_id='57820fd527c8464f98b51c416c00159e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Creating volume eef953dd-65f0-445c-a26e-a76fbe07de8e {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:22 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:22 devstack sudo[100639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e 1073741824
Aug 29 13:22:22 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:22 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e 1073741824" returned: 0 in 0.577s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:22 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e
Aug 29 13:22:22 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:23 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e" returned: 0 in 0.317s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fea540c-c85c-4d5a-8052-24208d5296a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef953dd-65f0-445c-a26e-a76fbe07de8e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbe4695-e797-45c8-a946-9a12edd36722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:23 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Volume volume-eef953dd-65f0-445c-a26e-a76fbe07de8e (eef953dd-65f0-445c-a26e-a76fbe07de8e): created successfully
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbe4695-e797-45c8-a946-9a12edd36722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Flow 'volume_create_manager' (7b27bd8f-7dcf-4217-b85d-0a11164ea695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-49311f5d-d22c-4492-bb37-189b828d7dc2 tempest-ProjectReaderTests-1530899140 None] Created volume successfully.
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Acquiring lock "cinder-eef953dd-65f0-445c-a26e-a76fbe07de8e-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Lock "cinder-eef953dd-65f0-445c-a26e-a76fbe07de8e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Acquiring lock "cinder-quobyte-eef953dd-65f0-445c-a26e-a76fbe07de8e" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Lock "cinder-quobyte-eef953dd-65f0-445c-a26e-a76fbe07de8e" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b1d9f7-7bbb-43ec-a34c-00d438055e45]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:24 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e
Aug 29 13:22:24 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Acquiring lock "cinder-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Lock "cinder-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Acquiring lock "cinder-quobyte-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c83da69-9e56-4365-8f2c-1d663bf03ea6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:24 devstack sudo[100655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf
Aug 29 13:22:24 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:24 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e" returned: 0 in 0.464s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:24 devstack sudo[100665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e
Aug 29 13:22:24 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:24 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eef953dd-65f0-445c-a26e-a76fbe07de8e" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Lock "cinder-quobyte-eef953dd-65f0-445c-a26e-a76fbe07de8e" released by "delete_volume" :: held 0.804s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:24 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" returned: 0 in 0.486s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:24 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf
Aug 29 13:22:24 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Created reservations ['028ec1b5-0f2c-451c-b744-08538671f2ca', 'ecdd11f3-ddec-446c-b2d0-3e0893e1d346', '8b2fcb72-e8d2-404c-801b-9464dfd3e426', 'a3b2dcc1-efaf-4bfd-89c3-92e0b851e228'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:25 devstack sudo[100705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:25 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:25 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" returned: 0 in 0.415s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf" released by "delete_volume" :: held 0.953s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Created reservations ['3630f2ed-3450-4c7b-bfee-d8ea240b9913', 'e93a6621-6d88-4c40-9590-c4245a11df17', '43703774-454e-4573-bbb0-79a43748c129', 'bddd68d7-196f-423a-8fed-c933da087e68'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:25 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.452s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Deleted volume successfully.
Aug 29 13:22:25 devstack sudo[100711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:25 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5f7b4c24-932e-4f4e-86e5-84946b88c1cd tempest-ProjectReaderTests-1530899140 None] Lock "cinder-eef953dd-65f0-445c-a26e-a76fbe07de8e-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:25 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.363s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Deleted volume successfully.
Aug 29 13:22:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29e70586-2893-4926-a5d8-8ce869a27ca9 tempest-TestStampPattern-1653392327 None] Lock "cinder-b3b7b452-eacf-4256-a5c3-4fcf84d50fdf-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Acquiring lock "cinder-e120c9c5-1d28-4afc-8150-8b3cdeb2fbde-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Lock "cinder-e120c9c5-1d28-4afc-8150-8b3cdeb2fbde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Acquiring lock "cinder-quobyte-40e56b36-0258-47ed-9265-627189a7fec4" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-40e56b36-0258-47ed-9265-627189a7fec4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Acquiring lock "cinder-quobyte-e120c9c5-1d28-4afc-8150-8b3cdeb2fbde" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-e120c9c5-1d28-4afc-8150-8b3cdeb2fbde" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Deleting offline snapshot e120c9c5-1d28-4afc-8150-8b3cdeb2fbde of volume 40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:22:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] snapshot_file for this snap is: volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:22:27 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeedbf2-8772-45f9-bb8b-b8cfd3685734]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:27 devstack sudo[100714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde
Aug 29 13:22:27 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:27 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde" returned: 0 in 0.432s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40e56b36-0258-47ed-9265-627189a7fec4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:22:27 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec554d5-f9d6-4501-9f1e-a80a5587d256]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:27 devstack sudo[100719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4
Aug 29 13:22:27 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:28 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4" returned: 0 in 0.612s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:28 devstack sudo[100725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde
Aug 29 13:22:28 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:28 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde" returned: 0 in 0.405s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:28 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde
Aug 29 13:22:28 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:28 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4.e120c9c5-1d28-4afc-8150-8b3cdeb2fbde" returned: 0 in 0.317s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-e120c9c5-1d28-4afc-8150-8b3cdeb2fbde" released by "_delete_snapshot" :: held 1.910s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-40e56b36-0258-47ed-9265-627189a7fec4" released by "delete_snapshot" :: held 1.943s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:29 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Created reservations ['f417d25e-5c63-439d-97f5-1faf66efce9a', '6a6e8b33-a99f-4e92-a72f-721dbf369f9a', 'f68a0f7b-6ab6-487e-a689-31438c50c804', '91240b65-3300-4d50-86b8-cf97da4fa25c'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:29 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Delete snapshot completed successfully.
Aug 29 13:22:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e379d6-d9c2-4e6e-b796-98593064173b tempest-TestStampPattern-1653392327 None] Lock "cinder-e120c9c5-1d28-4afc-8150-8b3cdeb2fbde-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-d3656817-1aa3-472e-9ba7-b46978353357 req-a925ad4f-1c69-4c91-9053-327073a510f1 tempest-TestShelveInstance-1250222549 None] Terminate volume connection completed successfully.
Aug 29 13:22:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-d3656817-1aa3-472e-9ba7-b46978353357 req-a925ad4f-1c69-4c91-9053-327073a510f1 tempest-TestShelveInstance-1250222549 None] Deleting attachment c9d45b03-57d4-4baa-92f0-abbf7959df2c. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:22:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Acquiring lock "cinder-00e29d92-1b84-43c7-8c16-967f74f04d60-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Lock "cinder-00e29d92-1b84-43c7-8c16-967f74f04d60-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Acquiring lock "cinder-quobyte-00e29d92-1b84-43c7-8c16-967f74f04d60" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Lock "cinder-quobyte-00e29d92-1b84-43c7-8c16-967f74f04d60" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:32 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb057fd-c268-498b-bb06-fcfe5d1fc693]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:33 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60
Aug 29 13:22:33 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:33 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60" returned: 0 in 0.669s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:33 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60
Aug 29 13:22:33 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:33 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00e29d92-1b84-43c7-8c16-967f74f04d60" returned: 0 in 0.470s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Lock "cinder-quobyte-00e29d92-1b84-43c7-8c16-967f74f04d60" released by "delete_volume" :: held 1.218s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG cinder.quota [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Created reservations ['f258bb29-949d-48dc-9640-6bd90b2764ba', '9bfbace2-b57a-4bdb-8e4d-9b25d4add09a', 'e012946a-3c22-4bb0-975f-0c272e1e4bef', 'd2f410ea-3289-4c21-9c50-15f17c1702ad'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:34 devstack sudo[100797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:34 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:34 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.387s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG cinder.manager [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Deleted volume successfully.
Aug 29 13:22:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [req-d3656817-1aa3-472e-9ba7-b46978353357 req-12b7f200-8a95-4a6b-a562-0560cd50195f tempest-TestShelveInstance-1250222549 None] Lock "cinder-00e29d92-1b84-43c7-8c16-967f74f04d60-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Acquiring lock "cinder-40e56b36-0258-47ed-9265-627189a7fec4-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Lock "cinder-40e56b36-0258-47ed-9265-627189a7fec4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Acquiring lock "cinder-quobyte-40e56b36-0258-47ed-9265-627189a7fec4" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-40e56b36-0258-47ed-9265-627189a7fec4" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e91e3-bea3-44f1-9438-abdd07757843]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:36 devstack sudo[100802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4
Aug 29 13:22:36 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:36 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4" returned: 0 in 0.391s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:36 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4
Aug 29 13:22:36 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:36 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-40e56b36-0258-47ed-9265-627189a7fec4" returned: 0 in 0.274s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Lock "cinder-quobyte-40e56b36-0258-47ed-9265-627189a7fec4" released by "delete_volume" :: held 0.740s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Created reservations ['0f18c19a-3cab-463a-b026-c0953fc05b87', '00819ad3-27bf-4fb9-ab4f-48f506991019', 'a5c07aee-093f-492b-a2bd-a2ff3b523594', 'e5d1f064-7d3c-4139-9b56-d3c7f7858e9f'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Flow 'volume_create_manager' (a97eefed-dc2f-4f96-99d1-9b1458a4929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43804b12-14f8-4370-81bb-770c763da5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43804b12-14f8-4370-81bb-770c763da5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-100326309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2d583d-e1d4-4f2b-bda3-f691d82b3067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e655c15d65014ea18e2aabe2bdaf0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:37Z,use_quota=True,user_id='852f3aa8ea4c4ad2abbb3edb91bf8d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a576fb39-093b-4e61-98e6-e476fbc72150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a576fb39-093b-4e61-98e6-e476fbc72150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2161562e-bd10-46e9-9664-800e851b8be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2161562e-bd10-46e9-9664-800e851b8be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd2d583d-e1d4-4f2b-bda3-f691d82b3067', 'volume_name': 'volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae96233-1a81-42c1-a98e-adf83f6114f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae96233-1a81-42c1-a98e-adf83f6114f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb0f8af-2fbc-420f-8e1d-4340ad76b4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:37 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Volume dd2d583d-e1d4-4f2b-bda3-f691d82b3067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067', 'volume_size': 1}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-100326309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2d583d-e1d4-4f2b-bda3-f691d82b3067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e655c15d65014ea18e2aabe2bdaf0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:37Z,use_quota=True,user_id='852f3aa8ea4c4ad2abbb3edb91bf8d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Creating volume dd2d583d-e1d4-4f2b-bda3-f691d82b3067 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:37 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:37 devstack sudo[100812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067 1073741824
Aug 29 13:22:37 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:37 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:37 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:37 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.289s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:37 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Deleted volume successfully.
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-bcf6ed40-0a2c-4ac8-9e35-0cc55e3806ad tempest-TestStampPattern-1653392327 None] Lock "cinder-40e56b36-0258-47ed-9265-627189a7fec4-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:37 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067 1073741824" returned: 0 in 0.539s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:37 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067
Aug 29 13:22:37 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:38 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb0f8af-2fbc-420f-8e1d-4340ad76b4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f536fe-f004-418f-98c9-83dac4e87775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:38 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Volume volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067 (dd2d583d-e1d4-4f2b-bda3-f691d82b3067): created successfully
Aug 29 13:22:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f536fe-f004-418f-98c9-83dac4e87775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Flow 'volume_create_manager' (a97eefed-dc2f-4f96-99d1-9b1458a4929f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-320c1efd-2814-4c20-bac0-3bad670d24ae tempest-VolumesListAdminTestJSON-2058404772 None] Created volume successfully.
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Flow 'volume_create_manager' (f5a5d632-0e82-4d8e-b706-a3e20d5c47f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d108825-255d-4bd1-8920-9e1a866334f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d108825-255d-4bd1-8920-9e1a866334f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1946548215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e2b8ea-8db4-4196-af3f-67fa32dc842a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e655c15d65014ea18e2aabe2bdaf0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:40Z,use_quota=True,user_id='852f3aa8ea4c4ad2abbb3edb91bf8d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3dfb3f-d442-4af4-a021-60131906bca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3dfb3f-d442-4af4-a021-60131906bca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e7b091-f121-4b22-af3f-d188b9d34496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e7b091-f121-4b22-af3f-d188b9d34496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e2b8ea-8db4-4196-af3f-67fa32dc842a', 'volume_name': 'volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771ea2cc-7b1a-4eb9-9006-e425e476e972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771ea2cc-7b1a-4eb9-9006-e425e476e972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa231ab9-975e-4e1e-bc7d-ace6fcbe312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:39 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Volume e1e2b8ea-8db4-4196-af3f-67fa32dc842a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a', 'volume_size': 1}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1946548215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e2b8ea-8db4-4196-af3f-67fa32dc842a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e655c15d65014ea18e2aabe2bdaf0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:40Z,use_quota=True,user_id='852f3aa8ea4c4ad2abbb3edb91bf8d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Creating volume e1e2b8ea-8db4-4196-af3f-67fa32dc842a {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:39 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:40 devstack sudo[100826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a 1073741824
Aug 29 13:22:40 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:40 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a 1073741824" returned: 0 in 0.511s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:40 devstack sudo[100832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a
Aug 29 13:22:40 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:40 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a" returned: 0 in 0.337s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa231ab9-975e-4e1e-bc7d-ace6fcbe312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e78670-a180-4f0d-8538-8d01a0f32f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:40 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Volume volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a (e1e2b8ea-8db4-4196-af3f-67fa32dc842a): created successfully
Aug 29 13:22:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e78670-a180-4f0d-8538-8d01a0f32f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Flow 'volume_create_manager' (f5a5d632-0e82-4d8e-b706-a3e20d5c47f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d1bd9aa6-0d06-428b-bc7a-43023be44074 tempest-VolumesListAdminTestJSON-2058404772 None] Created volume successfully.
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Flow 'volume_create_manager' (7fa02741-bf91-4a7f-a505-59413b528552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134e326c-ac2b-491b-b6d5-48ff67df8cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134e326c-ac2b-491b-b6d5-48ff67df8cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-43844125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e655c15d65014ea18e2aabe2bdaf0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:42Z,use_quota=True,user_id='852f3aa8ea4c4ad2abbb3edb91bf8d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0187db-6c0d-479d-a6db-716fad70a3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0187db-6c0d-479d-a6db-716fad70a3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd16acf-0bcc-4627-8a00-f68675837818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd16acf-0bcc-4627-8a00-f68675837818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f', 'volume_name': 'volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43ac92a-8b87-4935-a2b3-4de5827c1220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43ac92a-8b87-4935-a2b3-4de5827c1220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ac70ed-5abd-494c-951d-29b20a334b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:42 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Volume 8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f', 'volume_size': 1}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-43844125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e655c15d65014ea18e2aabe2bdaf0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:42Z,use_quota=True,user_id='852f3aa8ea4c4ad2abbb3edb91bf8d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Creating volume 8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:42 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:42 devstack sudo[100843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f 1073741824
Aug 29 13:22:42 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:43 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f 1073741824" returned: 0 in 0.470s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:43 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f
Aug 29 13:22:43 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:43 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f" returned: 0 in 0.289s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ac70ed-5abd-494c-951d-29b20a334b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31923c80-66c2-4868-8d71-aed2b06661df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:43 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Volume volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f (8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f): created successfully
Aug 29 13:22:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31923c80-66c2-4868-8d71-aed2b06661df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Flow 'volume_create_manager' (7fa02741-bf91-4a7f-a505-59413b528552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:43 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-47e521ed-91e3-481c-b3a7-323671dbad8e tempest-VolumesListAdminTestJSON-2058404772 None] Created volume successfully.
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Flow 'volume_create_manager' (ca1e6559-058a-40e5-99ab-0652430f0964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5db3d09-7472-46f8-980e-524f60d02fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5db3d09-7472-46f8-980e-524f60d02fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d154d6c-0e97-4c6c-ae52-c3bae3e43a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af056248a95b482f96fef07a5e517236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:46Z,use_quota=True,user_id='eda7ec7ac36b4e9a97735b9281c05d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a33703-0aa6-45cc-ba89-5fe4447bce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a33703-0aa6-45cc-ba89-5fe4447bce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323d102b-93db-451a-b91c-2db26a832f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323d102b-93db-451a-b91c-2db26a832f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d154d6c-0e97-4c6c-ae52-c3bae3e43a10', 'volume_name': 'volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed20c0e-e3bf-49a5-ab4f-9c61f80b1c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed20c0e-e3bf-49a5-ab4f-9c61f80b1c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1032d1-0e97-4c20-a24f-3da06930e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:45 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Volume 3d154d6c-0e97-4c6c-ae52-c3bae3e43a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10', 'volume_size': 1}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d154d6c-0e97-4c6c-ae52-c3bae3e43a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af056248a95b482f96fef07a5e517236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:46Z,use_quota=True,user_id='eda7ec7ac36b4e9a97735b9281c05d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Creating volume 3d154d6c-0e97-4c6c-ae52-c3bae3e43a10 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:45 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:45 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10 1073741824
Aug 29 13:22:45 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:46 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10 1073741824" returned: 0 in 0.530s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:46 devstack sudo[100860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10
Aug 29 13:22:46 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:46 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1032d1-0e97-4c20-a24f-3da06930e48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bd05d4-d873-4c75-9f9f-ea7006d03881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:46 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Volume volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10 (3d154d6c-0e97-4c6c-ae52-c3bae3e43a10): created successfully
Aug 29 13:22:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bd05d4-d873-4c75-9f9f-ea7006d03881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Flow 'volume_create_manager' (ca1e6559-058a-40e5-99ab-0652430f0964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:46 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-28fc772b-b6ec-40e0-a11f-8b00a7a59cef tempest-VolumesListAdminTestJSON-525781923 None] Created volume successfully.
Aug 29 13:22:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Acquiring lock "cinder-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Lock "cinder-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Acquiring lock "cinder-quobyte-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:47 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Lock "cinder-quobyte-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10" acquired by "delete_volume" :: waited 0.037s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:47 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[951ce2e4-30cd-4e3f-a7db-1c44ade5064d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "cinder-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "cinder-quobyte-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:48 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10
Aug 29 13:22:48 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-quobyte-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f" acquired by "delete_volume" :: waited 0.041s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c909037e-dd46-4611-a637-d52f210b6628]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:48 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f
Aug 29 13:22:48 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:48 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Flow 'volume_create_manager' (11b493da-a45e-4723-9c93-49b84de4ab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a6dccd-ebbc-4341-9be6-34c6c0b17c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10" returned: 0 in 0.524s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a6dccd-ebbc-4341-9be6-34c6c0b17c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2112701090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee4d418-36a9-425e-859f-bee755fe337a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e03503e2ce8e4c9198c6e78e03dfd013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:48Z,use_quota=True,user_id='235592ea6a1d45cdbe8154f7c4c95296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecc4f5a-f05f-46c4-80df-8e2ddbf33e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:48 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10
Aug 29 13:22:48 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecc4f5a-f05f-46c4-80df-8e2ddbf33e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8fcce5-a18f-4b95-8a58-774d2de1364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8fcce5-a18f-4b95-8a58-774d2de1364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee4d418-36a9-425e-859f-bee755fe337a', 'volume_name': 'volume-dee4d418-36a9-425e-859f-bee755fe337a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a09511-ee5c-4466-88c0-dba136bf22b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a09511-ee5c-4466-88c0-dba136bf22b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872dc586-0a76-4c6b-9227-30a82b3c29d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:48 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Volume dee4d418-36a9-425e-859f-bee755fe337a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee4d418-36a9-425e-859f-bee755fe337a', 'volume_size': 1}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2112701090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee4d418-36a9-425e-859f-bee755fe337a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e03503e2ce8e4c9198c6e78e03dfd013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:48Z,use_quota=True,user_id='235592ea6a1d45cdbe8154f7c4c95296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Creating volume dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:48 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:48 devstack sudo[100876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a 1073741824
Aug 29 13:22:48 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:48 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f" returned: 0 in 0.462s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:48 devstack sudo[100879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f
Aug 29 13:22:48 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:48 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10" returned: 0 in 0.289s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Lock "cinder-quobyte-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10" released by "delete_volume" :: held 0.864s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Created reservations ['2c5c8112-b0f0-4e4d-8a9a-0d6c0a4053bf', '6bac14d1-f7ab-4242-94c4-526ace52c3b3', '902810f9-1ea6-46dc-a70a-51deb747d0ac', 'a8cd3075-1ecc-4e44-add7-c1bc70bdc4ec'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:48 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f" returned: 0 in 0.299s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:48 devstack sudo[100887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:48 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-quobyte-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f" released by "delete_volume" :: held 0.828s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:48 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Created reservations ['317d302d-6f0f-4d7f-bca3-170deaa15ad6', 'e6a4aec7-fd66-4061-b7d5-4e5aa07650c6', '1ca8a076-a7df-4cf7-bb90-5125cdfa66b6', 'a856bae0-25cb-47a5-9f51-8cea7ef009f5'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:49 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a 1073741824" returned: 0 in 0.595s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:49 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:49 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:49 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a
Aug 29 13:22:49 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:49 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.318s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Deleted volume successfully.
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2e51870d-5dda-428b-be86-58f108f7d5b6 tempest-VolumesListAdminTestJSON-525781923 None] Lock "cinder-3d154d6c-0e97-4c6c-ae52-c3bae3e43a10-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "cinder-e1e2b8ea-8db4-4196-af3f-67fa32dc842a-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:49 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.313s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Deleted volume successfully.
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-e1e2b8ea-8db4-4196-af3f-67fa32dc842a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b24c56be-dc32-49b7-9506-c5e3a62bcc85 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-8ba0beb2-e38f-4386-84a1-6e6cf36c3c9f-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:49 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "cinder-quobyte-e1e2b8ea-8db4-4196-af3f-67fa32dc842a" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872dc586-0a76-4c6b-9227-30a82b3c29d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee4d418-36a9-425e-859f-bee755fe337a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d879e6-6f57-47e5-a8a4-05866d6bd128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-quobyte-e1e2b8ea-8db4-4196-af3f-67fa32dc842a" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:49 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Volume volume-dee4d418-36a9-425e-859f-bee755fe337a (dee4d418-36a9-425e-859f-bee755fe337a): created successfully
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d879e6-6f57-47e5-a8a4-05866d6bd128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Flow 'volume_create_manager' (11b493da-a45e-4723-9c93-49b84de4ab1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6409fc-d589-4d23-ae6c-b2ca03cbbbb8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-aca9f66c-fc38-4a1d-805f-7b4e27f362e0 tempest-VolumeDependencyTests-1736497299 None] Created volume successfully.
Aug 29 13:22:49 devstack sudo[100896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a
Aug 29 13:22:49 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:50 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a" returned: 0 in 0.390s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:50 devstack sudo[100901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a
Aug 29 13:22:50 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:50 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e1e2b8ea-8db4-4196-af3f-67fa32dc842a" returned: 0 in 0.268s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-quobyte-e1e2b8ea-8db4-4196-af3f-67fa32dc842a" released by "delete_volume" :: held 0.721s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Created reservations ['73b97bae-e3bd-4410-94f6-cc3459db52ce', '46a6d185-6723-4afa-bb94-9b8b47f3e17c', '558e3da4-c239-4ea6-be65-9eeaac066a9c', '83802daa-dbbb-40c4-95a3-ca1b2740fcd0'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:50 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:50 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:50 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.295s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:50 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Deleted volume successfully.
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "cinder-dd2d583d-e1d4-4f2b-bda3-f691d82b3067-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7b28c2be-964b-40c4-97a9-722aa40affa6 tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-e1e2b8ea-8db4-4196-af3f-67fa32dc842a-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-dd2d583d-e1d4-4f2b-bda3-f691d82b3067-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Creating offline snapshot 9a282989-399e-4af6-99d4-2a022a02abd1 of volume dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "cinder-quobyte-dd2d583d-e1d4-4f2b-bda3-f691d82b3067" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4034545e-84f8-412b-9d48-afc4a764f202]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-quobyte-dd2d583d-e1d4-4f2b-bda3-f691d82b3067" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd4af7-9c2b-4e4b-b043-adf489f377c4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:51 devstack sudo[100907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a
Aug 29 13:22:51 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:51 devstack sudo[100908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067
Aug 29 13:22:51 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:51 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:51 devstack sudo[100916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 1G
Aug 29 13:22:51 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:51 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067" returned: 0 in 0.406s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:51 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067
Aug 29 13:22:51 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:51 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dd2d583d-e1d4-4f2b-bda3-f691d82b3067" returned: 0 in 0.285s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-quobyte-dd2d583d-e1d4-4f2b-bda3-f691d82b3067" released by "delete_volume" :: held 0.739s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Created reservations ['fd823916-dfdf-4308-a2b7-3d9e86adbd53', 'd8e3d773-bcbf-491b-9024-30bc2a2483a7', '82a414e9-bf81-49ee-a8a1-56fd1ceaf320', 'f5fb6495-6135-4849-99b6-3073b60801db'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:22:51 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 1G" returned: 0 in 0.476s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee4d418-36a9-425e-859f-bee755fe337a -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:51 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee4d418-36a9-425e-859f-bee755fe337a -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1
Aug 29 13:22:51 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:51 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:51 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (c360cc9b-efe6-40e6-9e60-b17afae6159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdc43cf-4f90-4f49-b577-39c8513266bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdc43cf-4f90-4f49-b577-39c8513266bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751953318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77d2e8e-ae9c-449b-8d27-2788f3db2fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:52Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7bdc89-8c8c-4818-a804-48b3b8069740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7bdc89-8c8c-4818-a804-48b3b8069740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26771ad-0255-4335-84dc-cf7f3f8f77fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26771ad-0255-4335-84dc-cf7f3f8f77fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77d2e8e-ae9c-449b-8d27-2788f3db2fc5', 'volume_name': 'volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f80efff-934c-42f2-88b6-b0a4c77a9f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f80efff-934c-42f2-88b6-b0a4c77a9f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaabece-5d35-46a2-ae0c-24d48ad48750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:51 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume a77d2e8e-ae9c-449b-8d27-2788f3db2fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5', 'volume_size': 1}
Aug 29 13:22:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:52 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.270s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:52 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Deleted volume successfully.
Aug 29 13:22:52 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee4d418-36a9-425e-859f-bee755fe337a -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1" returned: 0 in 0.365s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:52 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 is being set with open permissions: ugo+rw
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-060dda26-0cac-4cc8-937b-ea45d56b5a8c tempest-VolumesListAdminTestJSON-2058404772 None] Lock "cinder-dd2d583d-e1d4-4f2b-bda3-f691d82b3067-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:22:52 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1
Aug 29 13:22:52 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:52 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1" returned: 0 in 0.261s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:52 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.info
Aug 29 13:22:52 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:52 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.info" returned: 0 in 0.253s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:52 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.info is being set with open permissions: ugo+rw
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:52 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.info
Aug 29 13:22:52 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:52 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.info" returned: 0 in 0.269s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751953318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77d2e8e-ae9c-449b-8d27-2788f3db2fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:52Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Creating volume a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:52 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:22:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:53 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 1073741824
Aug 29 13:22:53 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-22353e9b-fd47-442b-afa9-ccb38f99537e tempest-VolumeDependencyTests-1736497299 None] Create snapshot completed successfully
Aug 29 13:22:53 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 1073741824" returned: 0 in 0.475s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:53 devstack sudo[100951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5
Aug 29 13:22:53 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:53 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" returned: 0 in 0.247s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:22:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaabece-5d35-46a2-ae0c-24d48ad48750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8d2beb-e0d9-4e14-93cd-e8676f29dc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 (a77d2e8e-ae9c-449b-8d27-2788f3db2fc5): created successfully
Aug 29 13:22:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8d2beb-e0d9-4e14-93cd-e8676f29dc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (c360cc9b-efe6-40e6-9e60-b17afae6159c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ec085ce6-75e2-4be7-a15f-b0329c17f437 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created volume successfully.
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Flow 'volume_create_manager' (a6267779-3951-4246-9581-efa49a4870b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5519c781-fb01-4ec9-9bd5-5d8bbf0ad471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5519c781-fb01-4ec9-9bd5-5d8bbf0ad471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1319495944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa6af06-9b22-459b-a988-0d89b409cf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e03503e2ce8e4c9198c6e78e03dfd013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a282989-399e-4af6-99d4-2a022a02abd1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:54Z,use_quota=True,user_id='235592ea6a1d45cdbe8154f7c4c95296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008ed156-a298-4640-b803-d283222c8d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008ed156-a298-4640-b803-d283222c8d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a334b92d-bd01-4701-a0d7-0165839b9bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a334b92d-bd01-4701-a0d7-0165839b9bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eaa6af06-9b22-459b-a988-0d89b409cf9a', 'volume_name': 'volume-eaa6af06-9b22-459b-a988-0d89b409cf9a', 'volume_size': 1, 'snapshot_id': '9a282989-399e-4af6-99d4-2a022a02abd1'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221498e5-cdfb-46b3-b25a-3ea83c549dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221498e5-cdfb-46b3-b25a-3ea83c549dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56687b45-87bf-4972-b04a-5f587acedd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:54 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Volume eaa6af06-9b22-459b-a988-0d89b409cf9a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eaa6af06-9b22-459b-a988-0d89b409cf9a', 'volume_size': 1, 'snapshot_id': '9a282989-399e-4af6-99d4-2a022a02abd1'}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "cinder-quobyte-9a282989-399e-4af6-99d4-2a022a02abd1-eaa6af06-9b22-459b-a988-0d89b409cf9a" by "_create_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:54 devstack sudo[100954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:22:54 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-9a282989-399e-4af6-99d4-2a022a02abd1-eaa6af06-9b22-459b-a988-0d89b409cf9a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Creating volume eaa6af06-9b22-459b-a988-0d89b409cf9a from snapshot 9a282989-399e-4af6-99d4-2a022a02abd1 {{(pid=85771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "cinder-quobyte-eaa6af06-9b22-459b-a988-0d89b409cf9a" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-eaa6af06-9b22-459b-a988-0d89b409cf9a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] snapshot: 9a282989-399e-4af6-99d4-2a022a02abd1, volume: eaa6af06-9b22-459b-a988-0d89b409cf9a,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[47611959-ca68-4550-89f9-ac8a44898056]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:54 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1
Aug 29 13:22:54 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:54 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.303s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:22:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:55 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1" returned: 0 in 0.476s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dee4d418-36a9-425e-859f-bee755fe337a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde8f126-c294-433e-b6ed-cedcc3163303]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:55 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a
Aug 29 13:22:55 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:55 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a" returned: 0 in 0.356s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:22:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:55 devstack sudo[100968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a
Aug 29 13:22:55 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Flow 'volume_create_manager' (44c1b429-3674-498c-b406-220f77627ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7d06f-9699-41b9-89e1-7f0bc21e5bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7d06f-9699-41b9-89e1-7f0bc21e5bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1522086552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd60cc33-a854-4b8e-809d-31ea1f560d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0cb4e174c44a7d8a340f68c4f4e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:56Z,use_quota=True,user_id='6584e447d16942a48733df0423b3fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9cdb85-e614-4422-9c96-d84c860f5dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9cdb85-e614-4422-9c96-d84c860f5dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086f7c17-1ad8-48be-861c-e477b184eea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086f7c17-1ad8-48be-861c-e477b184eea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd60cc33-a854-4b8e-809d-31ea1f560d08', 'volume_name': 'volume-bd60cc33-a854-4b8e-809d-31ea1f560d08', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ca3b67-6ede-4580-bc28-006222286349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ca3b67-6ede-4580-bc28-006222286349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932d5b72-17c7-435a-935c-d12397815262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:22:56 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Volume bd60cc33-a854-4b8e-809d-31ea1f560d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd60cc33-a854-4b8e-809d-31ea1f560d08', 'volume_size': 1}
Aug 29 13:22:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:22:59 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root
Aug 29 13:22:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a" returned: 0 in 4.224s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:22:59 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:22:59 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Converted 1024.00 MB image at 242.39 MB/s
Aug 29 13:22:59 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a is being set with open permissions: ugo+rw
Aug 29 13:22:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:22:59 devstack sudo[100981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a
Aug 29 13:22:59 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:00 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a" returned: 0 in 0.242s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-eaa6af06-9b22-459b-a988-0d89b409cf9a" released by "_copy_volume_from_snapshot" :: held 5.396s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-9a282989-399e-4af6-99d4-2a022a02abd1-eaa6af06-9b22-459b-a988-0d89b409cf9a" released by "_create_volume_from_snapshot" :: held 5.463s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.481s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.907s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Creating offline snapshot c297df3a-00ed-42ad-a589-8cd68e982dbf of volume a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56687b45-87bf-4972-b04a-5f587acedd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa6af06-9b22-459b-a988-0d89b409cf9a', 'volume_size': 1, 'snapshot_id': '9a282989-399e-4af6-99d4-2a022a02abd1'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414570db-7231-413f-81c2-bb70ca07a97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1626eaca-851a-4d42-afdb-204ede7bdde4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:00 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Volume volume-eaa6af06-9b22-459b-a988-0d89b409cf9a (eaa6af06-9b22-459b-a988-0d89b409cf9a): created successfully
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414570db-7231-413f-81c2-bb70ca07a97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Flow 'volume_create_manager' (a6267779-3951-4246-9581-efa49a4870b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9d04cb95-12e0-4e66-a782-534b59e31fa1 tempest-VolumeDependencyTests-1736497299 None] Created volume successfully.
Aug 29 13:23:00 devstack sudo[100984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5
Aug 29 13:23:00 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:00 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" returned: 0 in 0.356s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:00 devstack sudo[100989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf 1G
Aug 29 13:23:00 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:00 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf 1G" returned: 0 in 0.377s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:00 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf
Aug 29 13:23:00 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "cinder-9a282989-399e-4af6-99d4-2a022a02abd1-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-9a282989-399e-4af6-99d4-2a022a02abd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "cinder-quobyte-dee4d418-36a9-425e-859f-bee755fe337a" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-dee4d418-36a9-425e-859f-bee755fe337a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "cinder-quobyte-9a282989-399e-4af6-99d4-2a022a02abd1" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-9a282989-399e-4af6-99d4-2a022a02abd1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Deleting offline snapshot 9a282989-399e-4af6-99d4-2a022a02abd1 of volume dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] snapshot_file for this snap is: volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cb8cde-f302-4617-a7ad-1222ab171773]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:01 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:01 devstack sudo[100997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1
Aug 29 13:23:01 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf" returned: 0 in 0.303s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:01 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf is being set with open permissions: ugo+rw
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:01 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf
Aug 29 13:23:01 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:01 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf" returned: 0 in 0.252s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:01 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1" returned: 0 in 0.371s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dee4d418-36a9-425e-859f-bee755fe337a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7272c910-cbca-4008-9756-efa48cdd3e2a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:01 devstack sudo[101009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.info
Aug 29 13:23:01 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:01 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a
Aug 29 13:23:01 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:01 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.info" returned: 0 in 0.252s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:01 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.info is being set with open permissions: ugo+rw
Aug 29 13:23:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:01 devstack sudo[101014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.info
Aug 29 13:23:01 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:02 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.info" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:02 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.878s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1522086552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd60cc33-a854-4b8e-809d-31ea1f560d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0cb4e174c44a7d8a340f68c4f4e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:22:56Z,use_quota=True,user_id='6584e447d16942a48733df0423b3fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Creating volume bd60cc33-a854-4b8e-809d-31ea1f560d08 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:02 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a" returned: 0 in 0.598s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:02 devstack sudo[101019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 1073741824
Aug 29 13:23:02 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:02 devstack sudo[101021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1
Aug 29 13:23:02 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f7d6de0b-c471-4a30-bf95-c02b0454b07d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Create snapshot completed successfully
Aug 29 13:23:02 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1" returned: 0 in 0.348s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:02 devstack sudo[101030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1
Aug 29 13:23:02 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:02 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 1073741824" returned: 0 in 0.443s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:02 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08
Aug 29 13:23:02 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:02 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a.9a282989-399e-4af6-99d4-2a022a02abd1" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-9a282989-399e-4af6-99d4-2a022a02abd1" released by "_delete_snapshot" :: held 1.688s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-dee4d418-36a9-425e-859f-bee755fe337a" released by "delete_snapshot" :: held 1.723s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:02 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08" returned: 0 in 0.277s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932d5b72-17c7-435a-935c-d12397815262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd60cc33-a854-4b8e-809d-31ea1f560d08', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a31fcd-1e43-4cf2-b47e-329305bf073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Created reservations ['ebcb6581-25a1-4400-9abf-b9037d26e1fe', '43dad02d-88c7-4bfc-89d8-a6c3fa655a97', '27824691-99b9-4b2c-8b8b-f82557df85fe', '6a6b4096-7699-40f5-81e4-75fb93e730d6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:02 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Volume volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 (bd60cc33-a854-4b8e-809d-31ea1f560d08): created successfully
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a31fcd-1e43-4cf2-b47e-329305bf073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Flow 'volume_create_manager' (44c1b429-3674-498c-b406-220f77627ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d4aefc0a-1b76-41a6-a73c-eeb23285ab02 tempest-SnapshotMetadataTestJSON-746997042 None] Created volume successfully.
Aug 29 13:23:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Delete snapshot completed successfully.
Aug 29 13:23:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e639caeb-4afd-47c0-afee-7dfcf238ab17 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-9a282989-399e-4af6-99d4-2a022a02abd1-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (863f05eb-e474-43c1-9c3b-f5173536d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762c47c3-75df-4ae6-ae17-84a2a0723fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762c47c3-75df-4ae6-ae17-84a2a0723fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1772656396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8f09dc-7fe6-4f52-a4af-89890041af8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:03Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c72eef8-9a82-4a9d-b031-74bdfb0680ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c72eef8-9a82-4a9d-b031-74bdfb0680ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1558e82b-a585-4fae-8d9f-6286bcf7379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1558e82b-a585-4fae-8d9f-6286bcf7379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8f09dc-7fe6-4f52-a4af-89890041af8c', 'volume_name': 'volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7568a6-264f-41e7-871a-2f088dcd1948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7568a6-264f-41e7-871a-2f088dcd1948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaf432d-d39e-4a97-8e1f-c51b6f3ce4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume cb8f09dc-7fe6-4f52-a4af-89890041af8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c', 'volume_size': 1}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1772656396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8f09dc-7fe6-4f52-a4af-89890041af8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:03Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Creating volume cb8f09dc-7fe6-4f52-a4af-89890041af8c {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:03 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "cinder-dee4d418-36a9-425e-859f-bee755fe337a-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-dee4d418-36a9-425e-859f-bee755fe337a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:03 devstack sudo[101037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c 1073741824
Aug 29 13:23:03 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "cinder-quobyte-dee4d418-36a9-425e-859f-bee755fe337a" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-dee4d418-36a9-425e-859f-bee755fe337a" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[166c1c18-f990-4b31-b2f6-9030003049c2]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:03 devstack sudo[101039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a
Aug 29 13:23:03 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (4bdc8e72-2f0e-481f-b566-89261614a4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae4ddb2-7cc2-4a93-b277-92b7b6ca2fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae4ddb2-7cc2-4a93-b277-92b7b6ca2fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347898553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d25ae63-52b3-4071-886d-c106d4da28b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:03Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13a9b0d-74ba-464f-a9ec-cd892ca84e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13a9b0d-74ba-464f-a9ec-cd892ca84e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2562af1-fb8f-42a1-996e-d21bb0a28457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2562af1-fb8f-42a1-996e-d21bb0a28457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d25ae63-52b3-4071-886d-c106d4da28b8', 'volume_name': 'volume-6d25ae63-52b3-4071-886d-c106d4da28b8', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47830fb6-c33d-44c4-8d90-d0c4170496d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47830fb6-c33d-44c4-8d90-d0c4170496d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3e3db7-2db0-4d05-b3c9-f860575f5105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:03 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume 6d25ae63-52b3-4071-886d-c106d4da28b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d25ae63-52b3-4071-886d-c106d4da28b8', 'volume_size': 1}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:03 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a" returned: 0 in 0.491s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:03 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c 1073741824" returned: 0 in 0.681s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:03 devstack sudo[101048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a
Aug 29 13:23:03 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:03 devstack sudo[101050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c
Aug 29 13:23:03 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (b8fa127b-1c2d-4d87-8ca9-69a66c21ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3a9b72-49ee-431c-a291-d97767c4e15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3a9b72-49ee-431c-a291-d97767c4e15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692635057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8095726-c1c7-4073-8c93-68681dfdc084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:04Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515c133b-f831-4b01-afc6-f75a4c9b291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515c133b-f831-4b01-afc6-f75a4c9b291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f6aa32-7492-49be-a140-52a0e011ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f6aa32-7492-49be-a140-52a0e011ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8095726-c1c7-4073-8c93-68681dfdc084', 'volume_name': 'volume-c8095726-c1c7-4073-8c93-68681dfdc084', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a53d59c-4d4c-4334-bcc8-0a205e6efcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a53d59c-4d4c-4334-bcc8-0a205e6efcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110fc78f-4093-4c12-81c5-2e4d41438d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume c8095726-c1c7-4073-8c93-68681dfdc084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8095726-c1c7-4073-8c93-68681dfdc084', 'volume_size': 1}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:04 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dee4d418-36a9-425e-859f-bee755fe337a" returned: 0 in 0.409s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-dee4d418-36a9-425e-859f-bee755fe337a" released by "delete_volume" :: held 0.974s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Created reservations ['24a1d2d8-419f-4309-8937-e0191319f1ff', '57f5bf57-806c-409b-a958-851a5d06236a', 'd70ba1e3-2d71-488e-9cdd-8916e092f6a4', 'a797211e-ea41-43f0-945b-c7855526d7e7'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:04 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c" returned: 0 in 0.439s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.753s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347898553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d25ae63-52b3-4071-886d-c106d4da28b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:03Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Creating volume 6d25ae63-52b3-4071-886d-c106d4da28b8 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:04 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:04 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8 1073741824
Aug 29 13:23:04 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaf432d-d39e-4a97-8e1f-c51b6f3ce4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b336ba6-3311-48f7-9e67-955eb0c5a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "cinder-eaa6af06-9b22-459b-a988-0d89b409cf9a-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:04 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c (cb8f09dc-7fe6-4f52-a4af-89890041af8c): created successfully
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b336ba6-3311-48f7-9e67-955eb0c5a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (863f05eb-e474-43c1-9c3b-f5173536d47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-eaa6af06-9b22-459b-a988-0d89b409cf9a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:04 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b7291a8b-8ca5-463e-808b-c0e87f99c286 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created volume successfully.
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:04 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:04 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (c232ffdc-434b-48bf-8c8a-4ca40169d544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb0d75f-e4c8-46f9-834e-55ed17b42c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb0d75f-e4c8-46f9-834e-55ed17b42c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-325775322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064ff353-fddb-4fa2-a448-6bbebaadaf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:04Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aab6da7-d3a8-428d-aa34-7f2661764b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aab6da7-d3a8-428d-aa34-7f2661764b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21d54fc-d29b-4e3b-9d9a-bfcf92136242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21d54fc-d29b-4e3b-9d9a-bfcf92136242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064ff353-fddb-4fa2-a448-6bbebaadaf0a', 'volume_name': 'volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322e4eec-18f3-4dda-8428-7114f737a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322e4eec-18f3-4dda-8428-7114f737a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fde9581-93fb-4b12-ad64-817a74a7a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:04 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume 064ff353-fddb-4fa2-a448-6bbebaadaf0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a', 'volume_size': 1}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "cinder-quobyte-eaa6af06-9b22-459b-a988-0d89b409cf9a" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-eaa6af06-9b22-459b-a988-0d89b409cf9a" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[07952173-5a66-453c-b097-2cbebe24ecad]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:05 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8 1073741824" returned: 0 in 0.617s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:05 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (6445a185-3973-403a-82ba-707c22856f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:05 devstack sudo[101061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a
Aug 29 13:23:05 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a859be-2e04-4adf-83b8-3c657dd1921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.402s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Deleted volume successfully.
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a859be-2e04-4adf-83b8-3c657dd1921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1237873515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e4b475-8418-4a2d-b7ef-6f116dc65e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:05Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da601b2-9d98-4f0d-ba41-595ec0597ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da601b2-9d98-4f0d-ba41-595ec0597ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd070b5c-a155-48f6-bab8-059cc2b5575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd070b5c-a155-48f6-bab8-059cc2b5575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e4b475-8418-4a2d-b7ef-6f116dc65e69', 'volume_name': 'volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d4665c-e30f-4ff4-84bd-b1b93ec4502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d4665c-e30f-4ff4-84bd-b1b93ec4502c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a47478-befb-4b88-9d98-309e08eb1b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:05 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume 25e4b475-8418-4a2d-b7ef-6f116dc65e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69', 'volume_size': 1}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fe0d0382-9e03-4c7a-bc58-56bb68a3eed2 tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-dee4d418-36a9-425e-859f-bee755fe337a-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:05 devstack sudo[101064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8
Aug 29 13:23:05 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:05 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a" returned: 0 in 0.445s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:05 devstack sudo[101069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a
Aug 29 13:23:05 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:05 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8" returned: 0 in 0.268s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.267s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3e3db7-2db0-4d05-b3c9-f860575f5105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d25ae63-52b3-4071-886d-c106d4da28b8', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76439aa9-c5f3-4ed6-baa8-8a3eaaefca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Creating offline snapshot c54750c2-e06a-42a9-83dd-8460cb675898 of volume bd60cc33-a854-4b8e-809d-31ea1f560d08 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:23:05 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume volume-6d25ae63-52b3-4071-886d-c106d4da28b8 (6d25ae63-52b3-4071-886d-c106d4da28b8): created successfully
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76439aa9-c5f3-4ed6-baa8-8a3eaaefca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (4bdc8e72-2f0e-481f-b566-89261614a4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aa2d0c-30b5-49f6-9579-6ceeeffaa590]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2c1d486b-f1c4-4173-b173-09dd2e9c6d4d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created volume successfully.
Aug 29 13:23:05 devstack sudo[101072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08
Aug 29 13:23:05 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:05 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-eaa6af06-9b22-459b-a988-0d89b409cf9a" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-quobyte-eaa6af06-9b22-459b-a988-0d89b409cf9a" released by "delete_volume" :: held 0.784s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Created reservations ['8a26242b-05af-459e-baa9-20a8ebe6bbbc', '2bd51b6e-2d3d-4808-8a7f-2ade67519a05', 'cb271321-7724-4c5f-aeac-8a4d9fa99989', '82934b7c-85ab-4da5-a6bd-c0c8b325f96a'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:05 devstack sudo[101075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:05 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:05 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08" returned: 0 in 0.406s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:05 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 1G
Aug 29 13:23:05 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:06 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.276s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:06 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Deleted volume successfully.
Aug 29 13:23:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1372512f-84e5-48bb-b889-99a7fe02d51b tempest-VolumeDependencyTests-1736497299 None] Lock "cinder-eaa6af06-9b22-459b-a988-0d89b409cf9a-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:06 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 1G" returned: 0 in 0.393s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:06 devstack sudo[101086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898
Aug 29 13:23:06 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:06 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:06 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 is being set with open permissions: ugo+rw
Aug 29 13:23:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:06 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898
Aug 29 13:23:06 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:06 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898" returned: 0 in 0.251s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:06 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.info
Aug 29 13:23:06 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:07 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.info" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:07 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.info is being set with open permissions: ugo+rw
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:07 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.info
Aug 29 13:23:07 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:07 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.info" returned: 0 in 0.249s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.154s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692635057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8095726-c1c7-4073-8c93-68681dfdc084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:04Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Creating volume c8095726-c1c7-4073-8c93-68681dfdc084 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:07 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:07 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084 1073741824
Aug 29 13:23:07 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0b998639-ecef-461f-ab6f-cabe08e1b3bf tempest-SnapshotMetadataTestJSON-746997042 None] Create snapshot completed successfully
Aug 29 13:23:07 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084 1073741824" returned: 0 in 0.466s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:07 devstack sudo[101106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084
Aug 29 13:23:07 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:08 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.333s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-325775322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064ff353-fddb-4fa2-a448-6bbebaadaf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:04Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Creating volume 064ff353-fddb-4fa2-a448-6bbebaadaf0a {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:08 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:08 devstack sudo[101109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a 1073741824
Aug 29 13:23:08 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110fc78f-4093-4c12-81c5-2e4d41438d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8095726-c1c7-4073-8c93-68681dfdc084', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf353f6-00fc-453b-b3c9-56c10ebc522a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:08 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume volume-c8095726-c1c7-4073-8c93-68681dfdc084 (c8095726-c1c7-4073-8c93-68681dfdc084): created successfully
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf353f6-00fc-453b-b3c9-56c10ebc522a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (b8fa127b-1c2d-4d87-8ca9-69a66c21ff09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:08 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6c719f5c-dd6e-44f7-a388-a03548259980 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created volume successfully.
Aug 29 13:23:08 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a 1073741824" returned: 0 in 0.575s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:08 devstack sudo[101115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a
Aug 29 13:23:08 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Acquiring lock "cinder-c54750c2-e06a-42a9-83dd-8460cb675898-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-c54750c2-e06a-42a9-83dd-8460cb675898-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Acquiring lock "cinder-quobyte-bd60cc33-a854-4b8e-809d-31ea1f560d08" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-quobyte-bd60cc33-a854-4b8e-809d-31ea1f560d08" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Acquiring lock "cinder-quobyte-c54750c2-e06a-42a9-83dd-8460cb675898" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-quobyte-c54750c2-e06a-42a9-83dd-8460cb675898" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Deleting offline snapshot c54750c2-e06a-42a9-83dd-8460cb675898 of volume bd60cc33-a854-4b8e-809d-31ea1f560d08 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] snapshot_file for this snap is: volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:23:09 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a" returned: 0 in 0.332s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a5b57-5da8-4a43-8090-9d044e0b84d5]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.992s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1237873515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e4b475-8418-4a2d-b7ef-6f116dc65e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34129190af734d19a284a50a30bc673b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:05Z,use_quota=True,user_id='4b9903d2fc0249c3b07299cf8445744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Creating volume 25e4b475-8418-4a2d-b7ef-6f116dc65e69 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:09 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:09 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69 1073741824
Aug 29 13:23:09 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fde9581-93fb-4b12-ad64-817a74a7a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac672df-9dfa-4b3b-b82d-2d93d011e085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:09 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a (064ff353-fddb-4fa2-a448-6bbebaadaf0a): created successfully
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac672df-9dfa-4b3b-b82d-2d93d011e085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (c232ffdc-434b-48bf-8c8a-4ca40169d544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ae228bf1-7147-4be1-8f16-c661657206c1 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created volume successfully.
Aug 29 13:23:09 devstack sudo[101119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898
Aug 29 13:23:09 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:09 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898" returned: 0 in 0.443s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd60cc33-a854-4b8e-809d-31ea1f560d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25449f1-9907-4d03-a695-2db199bcb9c3]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:09 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69 1073741824" returned: 0 in 0.525s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:09 devstack sudo[101130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69
Aug 29 13:23:09 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:09 devstack sudo[101129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08
Aug 29 13:23:09 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:09 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a47478-befb-4b88-9d98-309e08eb1b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dc4068-947f-491e-9868-1bce199f6439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:10 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Volume volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69 (25e4b475-8418-4a2d-b7ef-6f116dc65e69): created successfully
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dc4068-947f-491e-9868-1bce199f6439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Flow 'volume_create_manager' (6445a185-3973-403a-82ba-707c22856f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d53c59b7-c252-4f8b-a010-b63567293865 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created volume successfully.
Aug 29 13:23:10 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08" returned: 0 in 0.428s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:10 devstack sudo[101137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898
Aug 29 13:23:10 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:10 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:10 devstack sudo[101143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898
Aug 29 13:23:10 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-25e4b475-8418-4a2d-b7ef-6f116dc65e69-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-25e4b475-8418-4a2d-b7ef-6f116dc65e69-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-quobyte-25e4b475-8418-4a2d-b7ef-6f116dc65e69" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-25e4b475-8418-4a2d-b7ef-6f116dc65e69" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[952da4ba-39d2-4f4f-8de1-44c7260f5199]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:10 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08.c54750c2-e06a-42a9-83dd-8460cb675898" returned: 0 in 0.288s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-quobyte-c54750c2-e06a-42a9-83dd-8460cb675898" released by "_delete_snapshot" :: held 1.698s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-quobyte-bd60cc33-a854-4b8e-809d-31ea1f560d08" released by "delete_snapshot" :: held 1.728s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:10 devstack sudo[101146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69
Aug 29 13:23:10 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Created reservations ['ccca9bbe-a5d7-44c5-8c26-71e5ed0c4f9a', '94cfa975-a25e-47cf-91b6-d4a873ced186', 'be7a8096-d144-458e-a307-df627d32ff38', '9e050478-2997-464b-9634-98f1f2f3765a'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Delete snapshot completed successfully.
Aug 29 13:23:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4aac9ac5-5d46-4275-a453-09cce7bf591f tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-c54750c2-e06a-42a9-83dd-8460cb675898-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:11 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69" returned: 0 in 0.471s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:11 devstack sudo[101151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69
Aug 29 13:23:11 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Acquiring lock "cinder-bd60cc33-a854-4b8e-809d-31ea1f560d08-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-bd60cc33-a854-4b8e-809d-31ea1f560d08-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Acquiring lock "cinder-quobyte-bd60cc33-a854-4b8e-809d-31ea1f560d08" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-quobyte-bd60cc33-a854-4b8e-809d-31ea1f560d08" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a756894-7fab-49fb-8d32-0ec4f39abcc4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:11 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-25e4b475-8418-4a2d-b7ef-6f116dc65e69" returned: 0 in 0.316s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-25e4b475-8418-4a2d-b7ef-6f116dc65e69" released by "delete_volume" :: held 0.834s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created reservations ['cb678930-ca7a-405e-a27e-3a9f3859a4dd', '0efed8e9-f28a-4aec-975a-266ec3a0f118', 'ffe4cfea-c1da-48ba-838d-52b0f3faa50f', 'cfbf8327-a335-4be7-bc77-701142d239a8'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:11 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08
Aug 29 13:23:11 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:11 devstack sudo[101156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:11 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-064ff353-fddb-4fa2-a448-6bbebaadaf0a-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-064ff353-fddb-4fa2-a448-6bbebaadaf0a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-quobyte-064ff353-fddb-4fa2-a448-6bbebaadaf0a" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-064ff353-fddb-4fa2-a448-6bbebaadaf0a" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:11 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.305s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dcf0e7-1f9a-4f32-9959-03b263d4199f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Deleted volume successfully.
Aug 29 13:23:12 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08" returned: 0 in 0.553s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-63e9a293-cde6-48ff-8bc0-ade52f3be1f2 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-25e4b475-8418-4a2d-b7ef-6f116dc65e69-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:12 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08
Aug 29 13:23:12 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:12 devstack sudo[101162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a
Aug 29 13:23:12 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:12 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-bd60cc33-a854-4b8e-809d-31ea1f560d08" returned: 0 in 0.294s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-quobyte-bd60cc33-a854-4b8e-809d-31ea1f560d08" released by "delete_volume" :: held 0.929s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Created reservations ['e3f89ce6-ad7a-46b2-a084-0c6f5a9c77c2', 'cb0f12ed-bd4e-4469-89e9-2fe4b4ed17ce', '434efd45-c9f3-4559-8573-c284a967fc8c', '61f669d3-dc86-4458-9344-a730d9c436cb'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:12 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a" returned: 0 in 0.439s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:12 devstack sudo[101171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a
Aug 29 13:23:12 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:12 devstack sudo[101173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:12 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:12 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-064ff353-fddb-4fa2-a448-6bbebaadaf0a" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-064ff353-fddb-4fa2-a448-6bbebaadaf0a" released by "delete_volume" :: held 0.783s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:12 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.275s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Deleted volume successfully.
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created reservations ['b0c8727b-a251-435f-871b-6ed22b9286f0', '2dfa2212-90f9-49e9-9101-2e33961ea0ac', 'df4fc95a-da96-4195-b42c-de8d26ee4648', '54ece832-9e81-47ca-8b32-5b1ce722b408'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-18031bfd-0e71-45a2-98bc-e71153d5e3c7 tempest-SnapshotMetadataTestJSON-746997042 None] Lock "cinder-bd60cc33-a854-4b8e-809d-31ea1f560d08-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:12 devstack sudo[101177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:12 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-c8095726-c1c7-4073-8c93-68681dfdc084-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-c8095726-c1c7-4073-8c93-68681dfdc084-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-quobyte-c8095726-c1c7-4073-8c93-68681dfdc084" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-c8095726-c1c7-4073-8c93-68681dfdc084" acquired by "delete_volume" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb537ef-11a6-4256-bd80-9837c4f7c5ec]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:13 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.288s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Deleted volume successfully.
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d3574f4d-35cc-4871-b049-f717afa64628 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-064ff353-fddb-4fa2-a448-6bbebaadaf0a-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:13 devstack sudo[101181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084
Aug 29 13:23:13 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:13 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084" returned: 0 in 0.373s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:13 devstack sudo[101186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084
Aug 29 13:23:13 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:13 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c8095726-c1c7-4073-8c93-68681dfdc084" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-c8095726-c1c7-4073-8c93-68681dfdc084" released by "delete_volume" :: held 0.662s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created reservations ['12d69927-dec4-440c-b10c-0f07f0bf44f9', '98325479-a9eb-4d96-ba5a-895a9b4130e8', '551f1420-9963-40d1-8abd-9d0fc61ee9a7', '83c69ec2-18e9-4649-840a-0e797622f3af'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:13 devstack sudo[101189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:13 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:14 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.277s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:14 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Deleted volume successfully.
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-6d25ae63-52b3-4071-886d-c106d4da28b8-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7184dd10-a7df-40d0-8c80-61c21d03d133 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-c8095726-c1c7-4073-8c93-68681dfdc084-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-6d25ae63-52b3-4071-886d-c106d4da28b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-quobyte-6d25ae63-52b3-4071-886d-c106d4da28b8" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-6d25ae63-52b3-4071-886d-c106d4da28b8" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f19379c-f586-4d36-877f-5482ea3df181]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:14 devstack sudo[101192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8
Aug 29 13:23:14 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:14 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8" returned: 0 in 0.354s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:14 devstack sudo[101197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8
Aug 29 13:23:14 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:14 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d25ae63-52b3-4071-886d-c106d4da28b8" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-6d25ae63-52b3-4071-886d-c106d4da28b8" released by "delete_volume" :: held 0.663s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=146,cinder:INSERT=42,cinder:UPDATE=196,cinder:DELETE=15 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=152,cinder:INSERT=52,cinder:UPDATE=196,cinder:DELETE=19 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created reservations ['83626e9b-9b01-43a9-87dc-e0d3fdeaafa5', '82832a39-e557-4f6c-bbeb-f4a68c0d7fc4', '21b946d6-90de-4337-9421-746043916d67', '1fcfb545-2856-432a-9757-59214318044d'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:15 devstack sudo[101200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:15 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:15 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.251s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Deleted volume successfully.
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-cb8f09dc-7fe6-4f52-a4af-89890041af8c-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c0001275-988d-4feb-908c-9c862a50620a tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-6d25ae63-52b3-4071-886d-c106d4da28b8-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-cb8f09dc-7fe6-4f52-a4af-89890041af8c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-quobyte-cb8f09dc-7fe6-4f52-a4af-89890041af8c" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-cb8f09dc-7fe6-4f52-a4af-89890041af8c" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb5496f-1388-48c9-b178-2caf69930193]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:15 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c
Aug 29 13:23:15 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:15 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c" returned: 0 in 0.388s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:15 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c
Aug 29 13:23:15 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:16 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-cb8f09dc-7fe6-4f52-a4af-89890041af8c" returned: 0 in 0.251s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-cb8f09dc-7fe6-4f52-a4af-89890041af8c" released by "delete_volume" :: held 0.682s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created reservations ['16264945-ee43-4e43-a9d7-b422d90ee982', '80215d50-a84a-4ff1-9b4b-df5f00429abe', '8b1df7a6-e70c-4421-8e63-064248e5d6b6', '1123cde5-2af7-4d89-852b-75076dbcab12'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:16 devstack sudo[101211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:16 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Flow 'volume_create_manager' (de2c1878-93e5-4d5d-8d44-f525ae01880d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c9df3b-5d38-4270-b0f8-de36ff66f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c9df3b-5d38-4270-b0f8-de36ff66f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-537759415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37ea084-b0e8-42d2-a4dd-43da2919f464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ebe3a3f79d41f0818be258da58eb4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:16Z,use_quota=True,user_id='555271a196f54a11a70ec83ed7a91ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb6cfe4-aa34-4bdb-a35f-d67c3dd5f374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb6cfe4-aa34-4bdb-a35f-d67c3dd5f374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcaf55d-9477-4c01-9709-d4fc5bc817af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcaf55d-9477-4c01-9709-d4fc5bc817af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c37ea084-b0e8-42d2-a4dd-43da2919f464', 'volume_name': 'volume-c37ea084-b0e8-42d2-a4dd-43da2919f464', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0260869d-df62-4eca-94e7-7e5348a3073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0260869d-df62-4eca-94e7-7e5348a3073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3209cb38-0e09-4c6a-9ddd-e38ec4317fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:16 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Volume c37ea084-b0e8-42d2-a4dd-43da2919f464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c37ea084-b0e8-42d2-a4dd-43da2919f464', 'volume_size': 1}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-537759415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37ea084-b0e8-42d2-a4dd-43da2919f464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ebe3a3f79d41f0818be258da58eb4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:16Z,use_quota=True,user_id='555271a196f54a11a70ec83ed7a91ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Creating volume c37ea084-b0e8-42d2-a4dd-43da2919f464 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:16 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:16 devstack sudo[101213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464 1073741824
Aug 29 13:23:16 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-c297df3a-00ed-42ad-a589-8cd68e982dbf-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:16 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.274s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Deleted volume successfully.
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-c297df3a-00ed-42ad-a589-8cd68e982dbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-quobyte-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7a499d9-ba21-4adc-83c9-4e587467d2ef tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-cb8f09dc-7fe6-4f52-a4af-89890041af8c-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-quobyte-c297df3a-00ed-42ad-a589-8cd68e982dbf" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-c297df3a-00ed-42ad-a589-8cd68e982dbf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Deleting offline snapshot c297df3a-00ed-42ad-a589-8cd68e982dbf of volume a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] snapshot_file for this snap is: volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5938c3-ad8d-428b-b7fd-d20a7a7ef78a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:16 devstack sudo[101216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf
Aug 29 13:23:16 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:16 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464 1073741824" returned: 0 in 0.441s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:17 devstack sudo[101224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464
Aug 29 13:23:17 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:17 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf" returned: 0 in 0.376s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1cb5b9-ffa3-4a69-a3a7-ddc6e32352e6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:17 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5
Aug 29 13:23:17 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:17 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3209cb38-0e09-4c6a-9ddd-e38ec4317fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c37ea084-b0e8-42d2-a4dd-43da2919f464', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7f16bf-c8ee-45d3-adb0-afe8bec30d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:17 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Volume volume-c37ea084-b0e8-42d2-a4dd-43da2919f464 (c37ea084-b0e8-42d2-a4dd-43da2919f464): created successfully
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7f16bf-c8ee-45d3-adb0-afe8bec30d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Flow 'volume_create_manager' (de2c1878-93e5-4d5d-8d44-f525ae01880d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:17 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-750e49a7-eeae-40d9-b086-46f09924d94a tempest-VolumesMetadataTest-933857016 None] Created volume successfully.
Aug 29 13:23:17 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" returned: 0 in 0.373s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:17 devstack sudo[101236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf
Aug 29 13:23:17 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:17 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf" returned: 0 in 0.356s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:17 devstack sudo[101241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf
Aug 29 13:23:17 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:18 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5.c297df3a-00ed-42ad-a589-8cd68e982dbf" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-c297df3a-00ed-42ad-a589-8cd68e982dbf" released by "_delete_snapshot" :: held 1.464s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" released by "delete_snapshot" :: held 1.486s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Acquiring lock "cinder-c37ea084-b0e8-42d2-a4dd-43da2919f464-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Lock "cinder-c37ea084-b0e8-42d2-a4dd-43da2919f464-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Acquiring lock "cinder-quobyte-c37ea084-b0e8-42d2-a4dd-43da2919f464" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created reservations ['02ad1e7c-9602-4424-9df7-0b0e681a560c', 'fa14a590-80b2-478b-a44b-85fb7dea7002', '64e3e7ac-ce23-4919-bb01-b58acf68e83f', '12cddff6-74d3-442f-a886-7b2f72dfff26'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Lock "cinder-quobyte-c37ea084-b0e8-42d2-a4dd-43da2919f464" acquired by "delete_volume" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb53190-ba6f-4b4d-b9e3-a8829acd2c73]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Delete snapshot completed successfully.
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6112e634-4bb1-42c2-88d2-11ea08c47f30 tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-c297df3a-00ed-42ad-a589-8cd68e982dbf-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:18 devstack sudo[101244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464
Aug 29 13:23:18 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:18 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464" returned: 0 in 0.353s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:18 devstack sudo[101249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464
Aug 29 13:23:18 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "cinder-quobyte-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:18 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71b178d-584d-43d4-a868-330b70e1a2c4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c37ea084-b0e8-42d2-a4dd-43da2919f464" returned: 0 in 0.283s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Lock "cinder-quobyte-c37ea084-b0e8-42d2-a4dd-43da2919f464" released by "delete_volume" :: held 0.684s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:18 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Created reservations ['733ae932-9cff-4680-b960-82e8c1f20ffd', 'fba9e040-af78-482d-862e-b041fc73f80e', '37e135f0-3821-4646-981b-7d12ac1e20f5', '48113a09-4af2-467c-9fe9-976400ccf5f6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:19 devstack sudo[101252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5
Aug 29 13:23:19 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:19 devstack sudo[101254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:19 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:19 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" returned: 0 in 0.386s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:19 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:19 devstack sudo[101260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5
Aug 29 13:23:19 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:19 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Deleted volume successfully.
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-82df0c55-3b85-4e09-92d8-dbcffd40cfd6 tempest-VolumesMetadataTest-933857016 None] Lock "cinder-c37ea084-b0e8-42d2-a4dd-43da2919f464-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:19 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-quobyte-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5" released by "delete_volume" :: held 0.708s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Created reservations ['670a9980-9351-4fe8-9b94-beb381852a17', '812ff340-5289-41d5-9b5e-81baba571520', '7cc8173f-3a47-42d6-8f9a-e91943b73f02', 'c5943e40-1659-4812-b104-cdc21f9489c6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:19 devstack sudo[101263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:19 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:19 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.275s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:19 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:19 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Deleted volume successfully.
Aug 29 13:23:20 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d89ffb7e-2bd1-4fa5-8590-34c065c9408d tempest-CreateVolumesFromSnapshotTest-1821775644 None] Lock "cinder-a77d2e8e-ae9c-449b-8d27-2788f3db2fc5-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Flow 'volume_create_manager' (eae1684d-da3f-49db-bfd6-f8a69c7c8a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311b326d-645b-4c14-b37b-b33d8dc3a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311b326d-645b-4c14-b37b-b33d8dc3a953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-19895887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9388e65a-1df5-4b9d-b351-2fc00a6a38c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ba9d0fe0f4ca885bd3a4d2f65ccd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:24Z,use_quota=True,user_id='407585ec127c4cbc8628657e318014fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b87f1b2-6df8-4126-bbd3-8778ea1fa124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b87f1b2-6df8-4126-bbd3-8778ea1fa124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9eb575-84ca-45b9-80c6-c635987812ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9eb575-84ca-45b9-80c6-c635987812ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9388e65a-1df5-4b9d-b351-2fc00a6a38c9', 'volume_name': 'volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef225ad1-3252-4e45-b48b-a6f1ae5592c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef225ad1-3252-4e45-b48b-a6f1ae5592c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ed9dfc-1401-4545-b824-fb96f933e1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:23 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Volume 9388e65a-1df5-4b9d-b351-2fc00a6a38c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9', 'volume_size': 1}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-19895887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9388e65a-1df5-4b9d-b351-2fc00a6a38c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ba9d0fe0f4ca885bd3a4d2f65ccd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:24Z,use_quota=True,user_id='407585ec127c4cbc8628657e318014fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Creating volume 9388e65a-1df5-4b9d-b351-2fc00a6a38c9 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:23 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:23 devstack sudo[101268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9 1073741824
Aug 29 13:23:23 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:24 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9 1073741824" returned: 0 in 0.469s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:24 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9
Aug 29 13:23:24 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:24 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9" returned: 0 in 0.254s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ed9dfc-1401-4545-b824-fb96f933e1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af26834-2764-413f-ac0d-1ec50a5d2e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:24 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Volume volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9 (9388e65a-1df5-4b9d-b351-2fc00a6a38c9): created successfully
Aug 29 13:23:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af26834-2764-413f-ac0d-1ec50a5d2e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Flow 'volume_create_manager' (eae1684d-da3f-49db-bfd6-f8a69c7c8a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5633bd56-2013-42e6-89ae-bc7b70d63e3b tempest-VolumesTransfersTest-1311971834 None] Created volume successfully.
Aug 29 13:23:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-83010d1e-2063-4100-89d4-611ff811a254 tempest-VolumesTransfersTest-1522397549 None] Transfer volume completed successfully.
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Acquiring lock "cinder-9388e65a-1df5-4b9d-b351-2fc00a6a38c9-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Lock "cinder-9388e65a-1df5-4b9d-b351-2fc00a6a38c9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Acquiring lock "cinder-quobyte-9388e65a-1df5-4b9d-b351-2fc00a6a38c9" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Lock "cinder-quobyte-9388e65a-1df5-4b9d-b351-2fc00a6a38c9" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcede12-fb50-477a-9aed-1428aae3161c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:26 devstack sudo[101315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9
Aug 29 13:23:26 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:26 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9" returned: 0 in 0.389s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:26 devstack sudo[101320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9
Aug 29 13:23:26 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:26 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9388e65a-1df5-4b9d-b351-2fc00a6a38c9" returned: 0 in 0.271s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Lock "cinder-quobyte-9388e65a-1df5-4b9d-b351-2fc00a6a38c9" released by "delete_volume" :: held 0.703s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Created reservations ['486ee954-04ea-4a8f-97dd-f1fc2bc2be4d', 'f1557c5d-4317-4aa4-bd6f-9befd5210607', '7e9cf6c4-a9b2-4411-9a44-0e089b7bfec1', '745e04ae-8284-4411-a531-45aefd5fdf0b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:27 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:27 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:27 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.269s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:27 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Deleted volume successfully.
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-29c58778-df53-47ea-8fdb-49fb21487b9f tempest-VolumesTransfersTest-1394471188 None] Lock "cinder-9388e65a-1df5-4b9d-b351-2fc00a6a38c9-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Flow 'volume_create_manager' (159557d7-d54c-443b-a90b-2df4792b2a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70aa9461-e5d0-4290-86aa-72a8727c200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70aa9461-e5d0-4290-86aa-72a8727c200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1932084919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06d41f6-0c23-477b-9b7b-fbb33953da93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ba9d0fe0f4ca885bd3a4d2f65ccd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:28Z,use_quota=True,user_id='407585ec127c4cbc8628657e318014fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035d1a36-8b68-4c42-a236-7ff16a556d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035d1a36-8b68-4c42-a236-7ff16a556d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab126979-21c6-44d8-8e92-7c47582508eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab126979-21c6-44d8-8e92-7c47582508eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06d41f6-0c23-477b-9b7b-fbb33953da93', 'volume_name': 'volume-d06d41f6-0c23-477b-9b7b-fbb33953da93', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362d66a4-3853-40fc-b4f8-a63b695d14a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362d66a4-3853-40fc-b4f8-a63b695d14a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08d4ee9-7133-4c6c-a567-49fb0a4508eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:27 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Volume d06d41f6-0c23-477b-9b7b-fbb33953da93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06d41f6-0c23-477b-9b7b-fbb33953da93', 'volume_size': 1}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1932084919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06d41f6-0c23-477b-9b7b-fbb33953da93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5ba9d0fe0f4ca885bd3a4d2f65ccd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:28Z,use_quota=True,user_id='407585ec127c4cbc8628657e318014fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Creating volume d06d41f6-0c23-477b-9b7b-fbb33953da93 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:27 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:27 devstack sudo[101326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93 1073741824
Aug 29 13:23:27 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Flow 'volume_create_manager' (24badbbe-b35b-48ee-9709-0d179f6e1490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07654c0-d671-42d1-913e-00ebb78e803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:28 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93 1073741824" returned: 0 in 0.457s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07654c0-d671-42d1-913e-00ebb78e803c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-520471287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f516f564-8714-45a7-b95c-214b674de324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4cd0c6c9894aba878fd74daa14cbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:28Z,use_quota=True,user_id='df9a1899f0d54031a32b8a4026dbd39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d788d0-edf8-45c8-8370-4b3fa29be951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d788d0-edf8-45c8-8370-4b3fa29be951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a9da64-b4ae-455b-baa0-ce75292258a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a9da64-b4ae-455b-baa0-ce75292258a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f516f564-8714-45a7-b95c-214b674de324', 'volume_name': 'volume-f516f564-8714-45a7-b95c-214b674de324', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ccf96c-2809-4f2d-bde2-016b04376010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ccf96c-2809-4f2d-bde2-016b04376010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9c3071-74b1-4a2c-ba4f-8d5ad6b8abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:28 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Volume f516f564-8714-45a7-b95c-214b674de324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f516f564-8714-45a7-b95c-214b674de324', 'volume_size': 1}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:28 devstack sudo[101332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93
Aug 29 13:23:28 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:28 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93" returned: 0 in 0.239s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-520471287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f516f564-8714-45a7-b95c-214b674de324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4cd0c6c9894aba878fd74daa14cbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:28Z,use_quota=True,user_id='df9a1899f0d54031a32b8a4026dbd39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Creating volume f516f564-8714-45a7-b95c-214b674de324 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:28 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08d4ee9-7133-4c6c-a567-49fb0a4508eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06d41f6-0c23-477b-9b7b-fbb33953da93', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:28 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324 1073741824
Aug 29 13:23:28 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64998a32-4fc8-488c-8d00-21a61a7bfe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:28 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Volume volume-d06d41f6-0c23-477b-9b7b-fbb33953da93 (d06d41f6-0c23-477b-9b7b-fbb33953da93): created successfully
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64998a32-4fc8-488c-8d00-21a61a7bfe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Flow 'volume_create_manager' (159557d7-d54c-443b-a90b-2df4792b2a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:28 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4db36446-c290-4cb3-98ce-d9113e3f4513 tempest-VolumesTransfersTest-1311971834 None] Created volume successfully.
Aug 29 13:23:29 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324 1073741824" returned: 0 in 0.418s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:29 devstack sudo[101340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324
Aug 29 13:23:29 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:29 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324" returned: 0 in 0.242s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9c3071-74b1-4a2c-ba4f-8d5ad6b8abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f516f564-8714-45a7-b95c-214b674de324', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e37425-d6cb-41ec-a485-f20a3b9b6d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:29 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Volume volume-f516f564-8714-45a7-b95c-214b674de324 (f516f564-8714-45a7-b95c-214b674de324): created successfully
Aug 29 13:23:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e37425-d6cb-41ec-a485-f20a3b9b6d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:29 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Flow 'volume_create_manager' (24badbbe-b35b-48ee-9709-0d179f6e1490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:29 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e5287465-5251-4447-ad98-0a26af8d7d6f tempest-ProjectReaderTests-2032706346 None] Created volume successfully.
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Acquiring lock "cinder-d06d41f6-0c23-477b-9b7b-fbb33953da93-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Lock "cinder-d06d41f6-0c23-477b-9b7b-fbb33953da93-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Acquiring lock "cinder-quobyte-d06d41f6-0c23-477b-9b7b-fbb33953da93" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Lock "cinder-quobyte-d06d41f6-0c23-477b-9b7b-fbb33953da93" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e50b7a-c2de-4195-996e-92ae4688229c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:30 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93
Aug 29 13:23:30 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "cinder-f516f564-8714-45a7-b95c-214b674de324-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-f516f564-8714-45a7-b95c-214b674de324-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "cinder-quobyte-f516f564-8714-45a7-b95c-214b674de324" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:30 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93" returned: 0 in 0.374s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-quobyte-f516f564-8714-45a7-b95c-214b674de324" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:30 devstack sudo[101348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93
Aug 29 13:23:30 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2fd25d-c87e-479c-aace-3c6fe3782771]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:30 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324
Aug 29 13:23:30 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:30 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-d06d41f6-0c23-477b-9b7b-fbb33953da93" returned: 0 in 0.247s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Lock "cinder-quobyte-d06d41f6-0c23-477b-9b7b-fbb33953da93" released by "delete_volume" :: held 0.663s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:30 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Created reservations ['992d0563-3cd2-467e-84bb-d4f02ccd93b9', '92bada3f-a824-421b-b0dc-59970eebb3d1', '10a39ace-a82c-48cb-9926-0574f02094be', 'bc116c33-96e3-475a-adf2-0bcb0ac82e36'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:31 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324" returned: 0 in 0.372s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:31 devstack sudo[101356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:31 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:31 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324
Aug 29 13:23:31 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:31 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:31 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:31 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Deleted volume successfully.
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f516f564-8714-45a7-b95c-214b674de324" returned: 0 in 0.258s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-quobyte-f516f564-8714-45a7-b95c-214b674de324" released by "delete_volume" :: held 0.680s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-30d1032d-6b86-42dd-8797-64ae6ffe9d48 tempest-VolumesTransfersTest-1394471188 None] Lock "cinder-d06d41f6-0c23-477b-9b7b-fbb33953da93-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Created reservations ['ffd4e39d-c7d7-4143-a961-ae0028d38687', '84d9974a-4d88-4d45-a6e2-2fc6365e3c93', 'd01c2b68-ec8a-46a9-91c1-6ae5b4357214', '97a274b7-1a93-45c2-9927-82ff1efa55dd'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:31 devstack sudo[101362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:31 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:31 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.270s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:31 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Deleted volume successfully.
Aug 29 13:23:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96f56080-a8c6-4d58-b963-f7e508d5ef92 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-f516f564-8714-45a7-b95c-214b674de324-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Flow 'volume_create_manager' (946272ee-9aa4-471a-a771-1579e27c7b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac2c262-4a77-4b50-b217-14dbd472ee3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac2c262-4a77-4b50-b217-14dbd472ee3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-7278113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e4dda1-4fd5-41a0-ace8-ae8e63435c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4cd0c6c9894aba878fd74daa14cbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:32Z,use_quota=True,user_id='df9a1899f0d54031a32b8a4026dbd39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57802656-7ab8-46c6-b43a-ac620cda90a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57802656-7ab8-46c6-b43a-ac620cda90a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39af4614-930c-427c-b629-0b78dfeb3749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39af4614-930c-427c-b629-0b78dfeb3749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e4dda1-4fd5-41a0-ace8-ae8e63435c14', 'volume_name': 'volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41518537-69ad-462c-9a55-2d8342ba7a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41518537-69ad-462c-9a55-2d8342ba7a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3357d5af-a0f3-4b7d-b61d-d8edd6ee7e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:32 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Volume f7e4dda1-4fd5-41a0-ace8-ae8e63435c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14', 'volume_size': 1}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-7278113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e4dda1-4fd5-41a0-ace8-ae8e63435c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4cd0c6c9894aba878fd74daa14cbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:32Z,use_quota=True,user_id='df9a1899f0d54031a32b8a4026dbd39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Creating volume f7e4dda1-4fd5-41a0-ace8-ae8e63435c14 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:32 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:32 devstack sudo[101365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14 1073741824
Aug 29 13:23:32 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:32 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14 1073741824" returned: 0 in 0.461s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:32 devstack sudo[101370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14
Aug 29 13:23:32 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:33 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14" returned: 0 in 0.274s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3357d5af-a0f3-4b7d-b61d-d8edd6ee7e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af31f8a-6939-4458-ad49-18cad63092ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:33 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Volume volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14 (f7e4dda1-4fd5-41a0-ace8-ae8e63435c14): created successfully
Aug 29 13:23:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af31f8a-6939-4458-ad49-18cad63092ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Flow 'volume_create_manager' (946272ee-9aa4-471a-a771-1579e27c7b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:33 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-acb236b4-8073-4159-b4a4-c8b48a0c17bc tempest-ProjectReaderTests-2032706346 None] Created volume successfully.
Aug 29 13:23:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "cinder-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "cinder-quobyte-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-quobyte-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:34 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51fea33-3cad-4e40-968d-5d34dc8a0050]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:34 devstack sudo[101374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14
Aug 29 13:23:34 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:34 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14" returned: 0 in 0.398s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:34 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14
Aug 29 13:23:34 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:35 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14" returned: 0 in 0.272s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-quobyte-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14" released by "delete_volume" :: held 0.711s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Created reservations ['574ea481-381e-4522-9faa-8e5cf22fbd11', '08ece487-461d-48c7-a533-e288df009d1b', 'cc4a37de-4077-4e5e-8ea2-30a9c0c52f06', '6f5d7cc5-e8c6-4799-85fc-3d06da648503'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:35 devstack sudo[101382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:35 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:35 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.254s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:35 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Deleted volume successfully.
Aug 29 13:23:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fab2106a-5ca1-4905-8e72-e6a2caad69c1 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-f7e4dda1-4fd5-41a0-ace8-ae8e63435c14-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Flow 'volume_create_manager' (859f5a79-f7f5-4567-bb9b-2babdda66939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff22edb7-7e69-45f4-99ff-006cea7be308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff22edb7-7e69-45f4-99ff-006cea7be308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836056140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4cd0c6c9894aba878fd74daa14cbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:36Z,use_quota=True,user_id='df9a1899f0d54031a32b8a4026dbd39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942c8d11-89ed-4435-a9b0-c2c6ab2087f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942c8d11-89ed-4435-a9b0-c2c6ab2087f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef293848-f0af-4cb3-8331-e2faed172bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef293848-f0af-4cb3-8331-e2faed172bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2', 'volume_name': 'volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7205d5-1103-4faf-89f4-c38a471e8e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7205d5-1103-4faf-89f4-c38a471e8e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f04b98-9501-4c2c-8765-5bf1b725ee6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:36 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Volume 449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2', 'volume_size': 1}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836056140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4cd0c6c9894aba878fd74daa14cbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:36Z,use_quota=True,user_id='df9a1899f0d54031a32b8a4026dbd39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Creating volume 449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:36 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:36 devstack sudo[101385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2 1073741824
Aug 29 13:23:36 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:36 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2 1073741824" returned: 0 in 0.495s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:36 devstack sudo[101392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2
Aug 29 13:23:36 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:36 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f04b98-9501-4c2c-8765-5bf1b725ee6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57809d45-5544-4dfa-a1fe-27d6c9d2c408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:36 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Volume volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2 (449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2): created successfully
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57809d45-5544-4dfa-a1fe-27d6c9d2c408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Flow 'volume_create_manager' (859f5a79-f7f5-4567-bb9b-2babdda66939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:36 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d5ceb2ef-c65e-4d53-a532-9e62275008be tempest-ProjectReaderTests-2032706346 None] Created volume successfully.
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "cinder-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "cinder-quobyte-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-quobyte-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c29c4ca-9b17-4164-b40e-c52b56e9fdfc]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:38 devstack sudo[101395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2
Aug 29 13:23:38 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Flow 'volume_create_manager' (14c51926-96e9-4498-a54b-0425cb1e642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7787acb5-195a-4181-bfd9-cb895e3fa6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7787acb5-195a-4181-bfd9-cb895e3fa6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-170432292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527144f9-8be8-4b1f-bbd8-a853e66e2733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcf0328324f4e938b93495d32a83a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:38Z,use_quota=True,user_id='0a422269796e4932922307c73c9dae66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e766735-998e-40cb-8254-fe95170708b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e766735-998e-40cb-8254-fe95170708b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c1632f-cfd5-4eb6-8146-885c47fdbbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c1632f-cfd5-4eb6-8146-885c47fdbbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '527144f9-8be8-4b1f-bbd8-a853e66e2733', 'volume_name': 'volume-527144f9-8be8-4b1f-bbd8-a853e66e2733', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b56e4c1-6f5e-45d3-b23e-9a50aeb0e7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b56e4c1-6f5e-45d3-b23e-9a50aeb0e7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea66114-03f3-43c7-b32b-6c81596cab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:38 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Volume 527144f9-8be8-4b1f-bbd8-a853e66e2733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-527144f9-8be8-4b1f-bbd8-a853e66e2733', 'volume_size': 1}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-170432292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527144f9-8be8-4b1f-bbd8-a853e66e2733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcf0328324f4e938b93495d32a83a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:38Z,use_quota=True,user_id='0a422269796e4932922307c73c9dae66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Creating volume 527144f9-8be8-4b1f-bbd8-a853e66e2733 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:38 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:38 devstack sudo[101397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733 1073741824
Aug 29 13:23:38 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:38 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2" returned: 0 in 0.366s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:38 devstack sudo[101402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2
Aug 29 13:23:38 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:38 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2" returned: 0 in 0.256s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-quobyte-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2" released by "delete_volume" :: held 0.676s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:38 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733 1073741824" returned: 0 in 0.426s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Created reservations ['64bd03a3-faba-4daa-8f9d-840c82af52ad', '2eef6642-57e7-458f-b620-dbef2de5bfa2', '71195e98-f2f2-4116-bc8f-0bc11d2963d2', '3b4e2870-ae19-4abf-9f4f-ead58192cbca'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:39 devstack sudo[101408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733
Aug 29 13:23:39 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:39 devstack sudo[101410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:39 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:39 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733" returned: 0 in 0.271s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea66114-03f3-43c7-b32b-6c81596cab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527144f9-8be8-4b1f-bbd8-a853e66e2733', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc69d73-c420-40ea-812c-32cd1e110cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:39 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Volume volume-527144f9-8be8-4b1f-bbd8-a853e66e2733 (527144f9-8be8-4b1f-bbd8-a853e66e2733): created successfully
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc69d73-c420-40ea-812c-32cd1e110cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Flow 'volume_create_manager' (14c51926-96e9-4498-a54b-0425cb1e642a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:39 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-578eb643-a401-4a23-a89e-fc187f92b507 tempest-VolumesTransfersV357Test-1769145929 None] Created volume successfully.
Aug 29 13:23:39 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.277s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:39 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Deleted volume successfully.
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6eaafa9e-bde8-4d40-a898-a1cd0980d8c6 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-449a9fa3-f55d-4b49-baaa-2aeeb5a2adc2-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Flow 'volume_create_manager' (0cb5413b-1e16-4737-b5f9-ad8572cc4d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5f2d4b-fd7f-4f6a-b2b8-e6f7e33b64fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5f2d4b-fd7f-4f6a-b2b8-e6f7e33b64fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1571278736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3594d8b7-38ea-4aec-afc4-f9e5c55ba977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4cd0c6c9894aba878fd74daa14cbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:40Z,use_quota=True,user_id='df9a1899f0d54031a32b8a4026dbd39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95776da-6d76-445f-9efe-44af0b4f2f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95776da-6d76-445f-9efe-44af0b4f2f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80cfab4-152a-43e5-9d9f-fab26b4b0f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80cfab4-152a-43e5-9d9f-fab26b4b0f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3594d8b7-38ea-4aec-afc4-f9e5c55ba977', 'volume_name': 'volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9058836-78ac-42ed-af90-a9429d56e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9058836-78ac-42ed-af90-a9429d56e699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edd6fa0-5f0e-440c-81b9-49b8bb0516b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:39 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Volume 3594d8b7-38ea-4aec-afc4-f9e5c55ba977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977', 'volume_size': 1}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1571278736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3594d8b7-38ea-4aec-afc4-f9e5c55ba977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4cd0c6c9894aba878fd74daa14cbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:40Z,use_quota=True,user_id='df9a1899f0d54031a32b8a4026dbd39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Creating volume 3594d8b7-38ea-4aec-afc4-f9e5c55ba977 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:39 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:39 devstack sudo[101414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977 1073741824
Aug 29 13:23:39 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-82257d75-2ec8-416b-93ed-fb18fd9b9df4 tempest-VolumesTransfersV357Test-667379728 None] Transfer volume completed successfully.
Aug 29 13:23:40 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977 1073741824" returned: 0 in 0.470s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:40 devstack sudo[101420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977
Aug 29 13:23:40 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Acquiring lock "cinder-527144f9-8be8-4b1f-bbd8-a853e66e2733-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Lock "cinder-527144f9-8be8-4b1f-bbd8-a853e66e2733-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Acquiring lock "cinder-quobyte-527144f9-8be8-4b1f-bbd8-a853e66e2733" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:40 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Lock "cinder-quobyte-527144f9-8be8-4b1f-bbd8-a853e66e2733" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edd6fa0-5f0e-440c-81b9-49b8bb0516b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee8b11f-8908-40a3-aa16-bb55c89ed2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0633049-c648-4bd9-9014-2fb7e2dc9e1f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:40 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Volume volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977 (3594d8b7-38ea-4aec-afc4-f9e5c55ba977): created successfully
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee8b11f-8908-40a3-aa16-bb55c89ed2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Flow 'volume_create_manager' (0cb5413b-1e16-4737-b5f9-ad8572cc4d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-dd4aef70-4b3f-43df-b5b1-65c3ccd13c33 tempest-ProjectReaderTests-2032706346 None] Created volume successfully.
Aug 29 13:23:40 devstack sudo[101426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733
Aug 29 13:23:40 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:41 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733" returned: 0 in 0.375s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:41 devstack sudo[101434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733
Aug 29 13:23:41 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:41 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-527144f9-8be8-4b1f-bbd8-a853e66e2733" returned: 0 in 0.240s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Lock "cinder-quobyte-527144f9-8be8-4b1f-bbd8-a853e66e2733" released by "delete_volume" :: held 0.666s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Created reservations ['794fad58-e959-421b-bcc5-573e553d589f', '5e4a7649-f61e-430c-8213-7ca9fe081fac', 'a3d5ce96-59db-4a26-8ee7-da680c363ef5', 'e533e536-fa46-48c2-a839-c03604aaa9b2'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:41 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:41 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:41 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.251s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Deleted volume successfully.
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2ff80c18-66f5-4d90-82de-813d108561f4 tempest-VolumesTransfersV357Test-1734195638 None] Lock "cinder-527144f9-8be8-4b1f-bbd8-a853e66e2733-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "cinder-3594d8b7-38ea-4aec-afc4-f9e5c55ba977-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-3594d8b7-38ea-4aec-afc4-f9e5c55ba977-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "cinder-quobyte-3594d8b7-38ea-4aec-afc4-f9e5c55ba977" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-quobyte-3594d8b7-38ea-4aec-afc4-f9e5c55ba977" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20aeaab-4528-4f99-a554-a5ddb31f5a23]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:42 devstack sudo[101440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977
Aug 29 13:23:42 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Flow 'volume_create_manager' (33615691-fb56-4dba-ae84-c78efd7c89b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b7bcc4-5420-479e-aeb7-77588210e7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b7bcc4-5420-479e-aeb7-77588210e7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-449782945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee69fdd-8a0c-4f89-b04a-b0bd67838da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcf0328324f4e938b93495d32a83a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:42Z,use_quota=True,user_id='0a422269796e4932922307c73c9dae66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b038702-b0de-4671-89b4-dd52898a010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b038702-b0de-4671-89b4-dd52898a010c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9352efdf-646d-4659-a577-21869bbfd020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9352efdf-646d-4659-a577-21869bbfd020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee69fdd-8a0c-4f89-b04a-b0bd67838da1', 'volume_name': 'volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7292ff29-c2e3-4bf6-99b6-b00517a0b28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7292ff29-c2e3-4bf6-99b6-b00517a0b28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10011f91-6dca-4215-bfe5-c1f1c1b996e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:42 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Volume 3ee69fdd-8a0c-4f89-b04a-b0bd67838da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1', 'volume_size': 1}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:42 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-449782945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee69fdd-8a0c-4f89-b04a-b0bd67838da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcf0328324f4e938b93495d32a83a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:42Z,use_quota=True,user_id='0a422269796e4932922307c73c9dae66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Creating volume 3ee69fdd-8a0c-4f89-b04a-b0bd67838da1 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:42 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977" returned: 0 in 0.391s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:42 devstack sudo[101445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1 1073741824
Aug 29 13:23:42 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:42 devstack sudo[101446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977
Aug 29 13:23:42 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:42 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3594d8b7-38ea-4aec-afc4-f9e5c55ba977" returned: 0 in 0.245s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-quobyte-3594d8b7-38ea-4aec-afc4-f9e5c55ba977" released by "delete_volume" :: held 0.674s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Created reservations ['bd12e835-f8c8-404d-bee1-3d648f614cfe', '7263d08c-a47c-45e1-95ad-0cb0fac111b5', '46bf4fdd-9fba-47e6-a7e7-49a3e9e342f3', 'f4d1c887-11d5-45c7-abb8-3308ee96b260'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:42 devstack sudo[101454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:42 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:42 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1 1073741824" returned: 0 in 0.430s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:42 devstack sudo[101456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1
Aug 29 13:23:42 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:43 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.258s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:43 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Deleted volume successfully.
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d6a32572-4471-46a6-83c2-a7abf35c7394 tempest-ProjectReaderTests-2032706346 None] Lock "cinder-3594d8b7-38ea-4aec-afc4-f9e5c55ba977-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:43 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1" returned: 0 in 0.261s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10011f91-6dca-4215-bfe5-c1f1c1b996e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5861c8-8780-445d-817c-93f160ce13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:43 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Volume volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1 (3ee69fdd-8a0c-4f89-b04a-b0bd67838da1): created successfully
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5861c8-8780-445d-817c-93f160ce13ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Flow 'volume_create_manager' (33615691-fb56-4dba-ae84-c78efd7c89b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:43 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-714496dc-9fb4-4931-9cb9-49287e89c0d9 tempest-VolumesTransfersV357Test-1769145929 None] Created volume successfully.
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Acquiring lock "cinder-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Lock "cinder-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Acquiring lock "cinder-quobyte-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Lock "cinder-quobyte-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1" acquired by "delete_volume" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8b7107-c137-47e9-8e57-16fee71bc305]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:43 devstack sudo[101461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1
Aug 29 13:23:43 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:44 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1" returned: 0 in 0.392s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:44 devstack sudo[101467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1
Aug 29 13:23:44 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:44 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1" returned: 0 in 0.261s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Lock "cinder-quobyte-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1" released by "delete_volume" :: held 0.702s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Created reservations ['604ffee5-c972-42fc-8446-789b776d1380', '0f35ad47-c5a5-4d7d-b900-537a77c6a406', 'b93c56d7-0d0c-43cf-af8d-0a8e11f54ca1', '905296a4-08dc-4bc4-b296-59d8a609012c'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:44 devstack sudo[101470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:44 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:44 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:44 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Deleted volume successfully.
Aug 29 13:23:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3444c2d0-4bf1-4b90-acbf-f2bfd953551b tempest-VolumesTransfersV357Test-1734195638 None] Lock "cinder-3ee69fdd-8a0c-4f89-b04a-b0bd67838da1-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Flow 'volume_create_manager' (fc20a64c-72be-453b-a1fe-885836bd29ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb565805-f532-4d48-b688-fc5c44a71ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb565805-f532-4d48-b688-fc5c44a71ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1823647945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91649b3-b31d-4fbe-b52d-ece2617311b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fac7061b43945eebdb3eafa99cfabb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:50Z,use_quota=True,user_id='ef550637bf4e47fd9f08da9e482d7ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8d5d6e-d580-4702-9322-6acb118ba0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8d5d6e-d580-4702-9322-6acb118ba0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56523142-e238-49a2-9812-e24bca08e31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56523142-e238-49a2-9812-e24bca08e31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91649b3-b31d-4fbe-b52d-ece2617311b5', 'volume_name': 'volume-e91649b3-b31d-4fbe-b52d-ece2617311b5', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a841b189-7665-4878-a9d1-d000aefb98cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a841b189-7665-4878-a9d1-d000aefb98cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ee703b-c6ef-4f5f-b25b-211d69a2c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:50 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Volume e91649b3-b31d-4fbe-b52d-ece2617311b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91649b3-b31d-4fbe-b52d-ece2617311b5', 'volume_size': 1}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1823647945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91649b3-b31d-4fbe-b52d-ece2617311b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fac7061b43945eebdb3eafa99cfabb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:50Z,use_quota=True,user_id='ef550637bf4e47fd9f08da9e482d7ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Creating volume e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:23:50 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:50 devstack sudo[101474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 1073741824
Aug 29 13:23:50 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:50 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 1073741824" returned: 0 in 0.448s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:50 devstack sudo[101480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5
Aug 29 13:23:50 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:51 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5" returned: 0 in 0.256s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:23:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ee703b-c6ef-4f5f-b25b-211d69a2c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91649b3-b31d-4fbe-b52d-ece2617311b5', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5ec831-5b5e-46f3-9d69-e4b18b3c4407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:51 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Volume volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 (e91649b3-b31d-4fbe-b52d-ece2617311b5): created successfully
Aug 29 13:23:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5ec831-5b5e-46f3-9d69-e4b18b3c4407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:51 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Flow 'volume_create_manager' (fc20a64c-72be-453b-a1fe-885836bd29ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:51 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-629beeec-78a5-4553-9bab-f4acb8c51b39 tempest-VolumesCloneTest-470654598 None] Created volume successfully.
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Flow 'volume_create_manager' (7d72d50d-a08c-4c90-ab01-36cae219aec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241819e2-6644-4b03-96b1-56ca81b763d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241819e2-6644-4b03-96b1-56ca81b763d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1907392477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634fd0ab-83cd-48ee-88e2-9886a994ddf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fac7061b43945eebdb3eafa99cfabb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:23:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=e91649b3-b31d-4fbe-b52d-ece2617311b5,status='creating',terminated_at=None,updated_at=2026-08-29T11:23:53Z,use_quota=True,user_id='ef550637bf4e47fd9f08da9e482d7ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0f7c1b-5731-4eac-a59b-d85f0ebf9889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0f7c1b-5731-4eac-a59b-d85f0ebf9889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d67f06-41c4-4a06-b747-325940efa03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d67f06-41c4-4a06-b747-325940efa03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '634fd0ab-83cd-48ee-88e2-9886a994ddf2', 'volume_name': 'volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2', 'volume_size': 2, 'source_volid': 'e91649b3-b31d-4fbe-b52d-ece2617311b5', 'source_volstatus': 'available'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5b25d5-74ce-45b2-be75-631ebfc42445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5b25d5-74ce-45b2-be75-631ebfc42445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c4e2b1-2ea9-4ff8-b5a2-b91f2d05f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:23:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Volume 634fd0ab-83cd-48ee-88e2-9886a994ddf2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2', 'volume_size': 2, 'source_volid': 'e91649b3-b31d-4fbe-b52d-ece2617311b5', 'source_volstatus': 'available'}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:52 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Cloning volume e91649b3-b31d-4fbe-b52d-ece2617311b5 to volume 634fd0ab-83cd-48ee-88e2-9886a994ddf2
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Creating offline snapshot aa3de972-2116-4d52-a5f9-27fdb7fa6d8b of volume e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4fa61f-9ccf-4c53-8bcf-47a2df652b49]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:53 devstack sudo[101483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5
Aug 29 13:23:53 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:53 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5" returned: 0 in 0.378s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:53 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b 1G
Aug 29 13:23:53 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:53 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b 1G" returned: 0 in 0.447s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:53 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b
Aug 29 13:23:53 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:54 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b" returned: 0 in 0.310s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:54 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b is being set with open permissions: ugo+rw
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:54 devstack sudo[101500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b
Aug 29 13:23:54 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:54 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b" returned: 0 in 0.265s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:54 devstack sudo[101503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.info
Aug 29 13:23:54 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:54 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:23:54 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:54 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.info" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:54 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.info is being set with open permissions: ugo+rw
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:54 devstack sudo[101508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.info
Aug 29 13:23:54 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:54 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.290s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:23:54 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.info" returned: 0 in 0.279s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Acquiring lock "cinder-quobyte-634fd0ab-83cd-48ee-88e2-9886a994ddf2" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Lock "cinder-quobyte-634fd0ab-83cd-48ee-88e2-9886a994ddf2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] snapshot: aa3de972-2116-4d52-a5f9-27fdb7fa6d8b, volume: 634fd0ab-83cd-48ee-88e2-9886a994ddf2,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce83e765-baed-478a-927d-d0065588c67d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:55 devstack sudo[101512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b
Aug 29 13:23:55 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:55 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b" returned: 0 in 0.379s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91649b3-b31d-4fbe-b52d-ece2617311b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d77f44-1363-4b81-acf8-f4e6c50e2dfb]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:55 devstack sudo[101518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5
Aug 29 13:23:55 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:23:55 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5" returned: 0 in 0.419s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2 not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:23:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:23:55 devstack sudo[101523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2
Aug 29 13:23:55 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:00 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2" returned: 0 in 4.924s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:00 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:24:00 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Converted 1024.00 MB image at 207.90 MB/s
Aug 29 13:24:00 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2 is being set with open permissions: ugo+rw
Aug 29 13:24:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:00 devstack sudo[101537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2
Aug 29 13:24:00 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:01 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2" returned: 0 in 0.275s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Lock "cinder-quobyte-634fd0ab-83cd-48ee-88e2-9886a994ddf2" released by "_copy_volume_from_snapshot" :: held 6.073s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Acquiring lock "cinder-quobyte-aa3de972-2116-4d52-a5f9-27fdb7fa6d8b" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Lock "cinder-quobyte-aa3de972-2116-4d52-a5f9-27fdb7fa6d8b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Deleting offline snapshot aa3de972-2116-4d52-a5f9-27fdb7fa6d8b of volume e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] snapshot_file for this snap is: volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8041326-b53b-4e81-919e-037af7659f92]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:01 devstack sudo[101542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b
Aug 29 13:24:01 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:01 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b" returned: 0 in 0.354s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91649b3-b31d-4fbe-b52d-ece2617311b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd55b6f8-7613-4d87-acf9-eba3c037380d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:01 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5
Aug 29 13:24:01 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:02 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5" returned: 0 in 0.547s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:02 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b
Aug 29 13:24:02 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:02 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b" returned: 0 in 0.332s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:02 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b
Aug 29 13:24:02 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:02 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5.aa3de972-2116-4d52-a5f9-27fdb7fa6d8b" returned: 0 in 0.254s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Lock "cinder-quobyte-aa3de972-2116-4d52-a5f9-27fdb7fa6d8b" released by "_delete_snapshot" :: held 1.590s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.830s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c4e2b1-2ea9-4ff8-b5a2-b91f2d05f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2', 'volume_size': 2, 'source_volid': 'e91649b3-b31d-4fbe-b52d-ece2617311b5', 'source_volstatus': 'available'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d38946c-8ee6-42bd-a2d1-de1cb4c5ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:02 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Volume volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2 (634fd0ab-83cd-48ee-88e2-9886a994ddf2): created successfully
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d38946c-8ee6-42bd-a2d1-de1cb4c5ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Flow 'volume_create_manager' (7d72d50d-a08c-4c90-ab01-36cae219aec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:24:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b1afa112-4381-4fa8-857b-616926af9e03 tempest-VolumesCloneTest-470654598 None] Created volume successfully.
Aug 29 13:24:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Acquiring lock "cinder-634fd0ab-83cd-48ee-88e2-9886a994ddf2-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Lock "cinder-634fd0ab-83cd-48ee-88e2-9886a994ddf2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Acquiring lock "cinder-quobyte-634fd0ab-83cd-48ee-88e2-9886a994ddf2" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Lock "cinder-quobyte-634fd0ab-83cd-48ee-88e2-9886a994ddf2" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b74fe09-c99e-41f6-9f3c-e24ce6924d00]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:04 devstack sudo[101561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2
Aug 29 13:24:04 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:04 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2" returned: 0 in 0.443s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:04 devstack sudo[101566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2
Aug 29 13:24:04 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:04 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-634fd0ab-83cd-48ee-88e2-9886a994ddf2" returned: 0 in 0.243s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Lock "cinder-quobyte-634fd0ab-83cd-48ee-88e2-9886a994ddf2" released by "delete_volume" :: held 0.730s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Created reservations ['39b15a40-fc70-4c65-ab2f-c3a2f38b2ea9', '4b46a966-adc5-4829-8332-646ad0a4b9e3', '1ab692b4-da85-4d3b-8106-52fa7c173ab5', '388a5cde-6b43-4943-9286-5104b89fe0bc'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:04 devstack sudo[101569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:24:04 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:05 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.265s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:24:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Deleted volume successfully.
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ad63628-4711-4740-b057-32de9ebf2c7a tempest-VolumesCloneTest-470654598 None] Lock "cinder-634fd0ab-83cd-48ee-88e2-9886a994ddf2-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Acquiring lock "cinder-e91649b3-b31d-4fbe-b52d-ece2617311b5-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Lock "cinder-e91649b3-b31d-4fbe-b52d-ece2617311b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Acquiring lock "cinder-quobyte-e91649b3-b31d-4fbe-b52d-ece2617311b5" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Lock "cinder-quobyte-e91649b3-b31d-4fbe-b52d-ece2617311b5" acquired by "delete_volume" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[430e4bf4-3185-4c16-bc59-7583359abf4f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:05 devstack sudo[101572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5
Aug 29 13:24:05 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:05 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5" returned: 0 in 0.377s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:05 devstack sudo[101577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5
Aug 29 13:24:05 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:05 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e91649b3-b31d-4fbe-b52d-ece2617311b5" returned: 0 in 0.282s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Lock "cinder-quobyte-e91649b3-b31d-4fbe-b52d-ece2617311b5" released by "delete_volume" :: held 0.742s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Created reservations ['d32b70ff-d830-4cb9-93af-f1fc2d623c40', '25ba2787-8188-4846-9f87-9929f3fd942b', 'aec310ae-f26f-484a-9715-4fcedcc35b22', 'ae63b059-aaef-4aaf-8c4b-d343cf0b6181'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:06 devstack sudo[101580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:24:06 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:06 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.275s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:24:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Deleted volume successfully.
Aug 29 13:24:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b4c94e1b-70a7-458e-8cee-a3b36718376f tempest-VolumesCloneTest-470654598 None] Lock "cinder-e91649b3-b31d-4fbe-b52d-ece2617311b5-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Flow 'volume_create_manager' (08af2780-fcd3-459d-8294-4ea81fbea25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfa7647-1a08-481a-b23a-7eea8d40b57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfa7647-1a08-481a-b23a-7eea8d40b57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1600091819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b63871-8220-431e-879d-95653230042f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ae4ce6b0ab484b81fe984d3a4219d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:24:09Z,use_quota=True,user_id='89ba11539c1044628073a5e523a4a7fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa9d099-1a09-4174-9ff2-a1364c50c966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa9d099-1a09-4174-9ff2-a1364c50c966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdfeaea-1136-45ff-8566-adb6550a1f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdfeaea-1136-45ff-8566-adb6550a1f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b63871-8220-431e-879d-95653230042f', 'volume_name': 'volume-72b63871-8220-431e-879d-95653230042f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad98c3e-cb45-4e5e-8eea-f68c8db996e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad98c3e-cb45-4e5e-8eea-f68c8db996e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af79e0d6-d642-4206-bc90-3878539799d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:09 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Volume 72b63871-8220-431e-879d-95653230042f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b63871-8220-431e-879d-95653230042f', 'volume_size': 1}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1600091819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b63871-8220-431e-879d-95653230042f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ae4ce6b0ab484b81fe984d3a4219d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:24:09Z,use_quota=True,user_id='89ba11539c1044628073a5e523a4a7fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Creating volume 72b63871-8220-431e-879d-95653230042f {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:24:09 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:09 devstack sudo[101583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f 1073741824
Aug 29 13:24:09 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:09 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f 1073741824" returned: 0 in 0.424s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:09 devstack sudo[101589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f
Aug 29 13:24:09 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:09 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f" returned: 0 in 0.249s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af79e0d6-d642-4206-bc90-3878539799d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b63871-8220-431e-879d-95653230042f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344a063c-5231-409a-af06-d71605d127e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:09 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Volume volume-72b63871-8220-431e-879d-95653230042f (72b63871-8220-431e-879d-95653230042f): created successfully
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344a063c-5231-409a-af06-d71605d127e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Flow 'volume_create_manager' (08af2780-fcd3-459d-8294-4ea81fbea25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:24:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-03b91f90-d610-4f4c-9033-bedb94ba1d85 tempest-SnapshotDependencyTests-1818507951 None] Created volume successfully.
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Creating offline snapshot 35266f17-b33e-4aaa-92e0-77da485ca69e of volume 72b63871-8220-431e-879d-95653230042f {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Flow 'volume_create_manager' (500911bf-7dd0-45da-a17c-b6cbb6d276ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6256aec7-df94-4f5d-805c-2ea86155dc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa62809-9641-459e-88a5-e1cd5ddf2197]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6256aec7-df94-4f5d-805c-2ea86155dc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-64821528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9f1059-727d-4e2c-8946-c4f669657d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38d828ee4fa47a49f874dd188546b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:24:10Z,use_quota=True,user_id='85ebaba77b18467e8b1998078bd64f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8bc7a5-b827-4c69-adfc-55f14aa90cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8bc7a5-b827-4c69-adfc-55f14aa90cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b7c287-17d0-4395-90f1-b94be1644412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b7c287-17d0-4395-90f1-b94be1644412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9f1059-727d-4e2c-8946-c4f669657d2c', 'volume_name': 'volume-0b9f1059-727d-4e2c-8946-c4f669657d2c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edda1c5-4572-4ea0-a3ea-3f6fd85ecc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edda1c5-4572-4ea0-a3ea-3f6fd85ecc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7c91bc-e578-48f3-8f23-c120a0a00743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:10 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Volume 0b9f1059-727d-4e2c-8946-c4f669657d2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9f1059-727d-4e2c-8946-c4f669657d2c', 'volume_size': 1}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:10 devstack sudo[101592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f
Aug 29 13:24:10 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:10 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f" returned: 0 in 0.344s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:10 devstack sudo[101597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e 1G
Aug 29 13:24:10 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:11 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e 1G" returned: 0 in 0.384s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b63871-8220-431e-879d-95653230042f -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:11 devstack sudo[101603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b63871-8220-431e-879d-95653230042f -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e
Aug 29 13:24:11 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:11 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b63871-8220-431e-879d-95653230042f -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:11 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e is being set with open permissions: ugo+rw
Aug 29 13:24:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:11 devstack sudo[101608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e
Aug 29 13:24:11 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:11 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e" returned: 0 in 0.242s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:11 devstack sudo[101611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.info
Aug 29 13:24:11 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:11 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.info" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:11 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.info is being set with open permissions: ugo+rw
Aug 29 13:24:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:12 devstack sudo[101614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.info
Aug 29 13:24:12 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:12 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.info" returned: 0 in 0.240s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-64821528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9f1059-727d-4e2c-8946-c4f669657d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38d828ee4fa47a49f874dd188546b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:24:10Z,use_quota=True,user_id='85ebaba77b18467e8b1998078bd64f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Creating volume 0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:24:12 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:12 devstack sudo[101617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c 1073741824
Aug 29 13:24:12 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a5dca4b3-24e3-49ca-a243-b94062821979 tempest-SnapshotDependencyTests-1818507951 None] Create snapshot completed successfully
Aug 29 13:24:12 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c 1073741824" returned: 0 in 0.435s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:12 devstack sudo[101623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c
Aug 29 13:24:12 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:12 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:24:13 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c" returned: 0 in 0.278s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Flow 'volume_create_manager' (c7e53bfb-5a95-48f0-a620-572bbe37d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c59351b-22f0-43eb-a2c4-f8774e9fbd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c59351b-22f0-43eb-a2c4-f8774e9fbd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06e3bd3-ac18-430d-943c-ed7cb979ec07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ae4ce6b0ab484b81fe984d3a4219d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=35266f17-b33e-4aaa-92e0-77da485ca69e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:24:13Z,use_quota=True,user_id='89ba11539c1044628073a5e523a4a7fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db94385f-af00-4049-9543-9fa181382aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db94385f-af00-4049-9543-9fa181382aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c769bfb1-1f65-4d50-be77-86fc624a24ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c769bfb1-1f65-4d50-be77-86fc624a24ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b06e3bd3-ac18-430d-943c-ed7cb979ec07', 'volume_name': 'volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07', 'volume_size': 1, 'snapshot_id': '35266f17-b33e-4aaa-92e0-77da485ca69e'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f775d03b-5742-45e0-bb89-0448f4283120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f775d03b-5742-45e0-bb89-0448f4283120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7107436-93d0-48a9-ac00-c5d6420d8fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:13 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Volume b06e3bd3-ac18-430d-943c-ed7cb979ec07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07', 'volume_size': 1, 'snapshot_id': '35266f17-b33e-4aaa-92e0-77da485ca69e'}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7c91bc-e578-48f3-8f23-c120a0a00743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9f1059-727d-4e2c-8946-c4f669657d2c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d1b142-5785-4e68-add9-db2e4b0208b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "cinder-quobyte-35266f17-b33e-4aaa-92e0-77da485ca69e-b06e3bd3-ac18-430d-943c-ed7cb979ec07" by "_create_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:13 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Volume volume-0b9f1059-727d-4e2c-8946-c4f669657d2c (0b9f1059-727d-4e2c-8946-c4f669657d2c): created successfully
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d1b142-5785-4e68-add9-db2e4b0208b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Flow 'volume_create_manager' (500911bf-7dd0-45da-a17c-b6cbb6d276ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-35266f17-b33e-4aaa-92e0-77da485ca69e-b06e3bd3-ac18-430d-943c-ed7cb979ec07" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Creating volume b06e3bd3-ac18-430d-943c-ed7cb979ec07 from snapshot 35266f17-b33e-4aaa-92e0-77da485ca69e {{(pid=85771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "cinder-quobyte-b06e3bd3-ac18-430d-943c-ed7cb979ec07" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-b06e3bd3-ac18-430d-943c-ed7cb979ec07" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] snapshot: 35266f17-b33e-4aaa-92e0-77da485ca69e, volume: b06e3bd3-ac18-430d-943c-ed7cb979ec07,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:24:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-59178fed-2efb-4af2-ba72-322bae7e0dff tempest-VolumesSnapshotListTestJSON-129201184 None] Created volume successfully.
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7ce2c7-3e12-4ea4-8047-d9a407db7d3e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:13 devstack sudo[101627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e
Aug 29 13:24:13 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:13 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e" returned: 0 in 0.362s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b63871-8220-431e-879d-95653230042f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1a8f07-5a3a-490d-ad53-d79de60e5aac]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:13 devstack sudo[101632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f
Aug 29 13:24:13 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:13 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f" returned: 0 in 0.370s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07 not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:24:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:13 devstack sudo[101637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07
Aug 29 13:24:13 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:18 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07" returned: 0 in 4.042s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:24:18 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Converted 1024.00 MB image at 253.24 MB/s
Aug 29 13:24:18 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07 is being set with open permissions: ugo+rw
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:18 devstack sudo[101650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07
Aug 29 13:24:18 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:18 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07" returned: 0 in 0.245s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-b06e3bd3-ac18-430d-943c-ed7cb979ec07" released by "_copy_volume_from_snapshot" :: held 5.101s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:INSERT=36,cinder:UPDATE=158,cinder:SELECT=110,cinder:DELETE=6 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=110,cinder:INSERT=40,cinder:UPDATE=163,cinder:DELETE=22 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-35266f17-b33e-4aaa-92e0-77da485ca69e-b06e3bd3-ac18-430d-943c-ed7cb979ec07" released by "_create_volume_from_snapshot" :: held 5.170s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.194s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.642s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Creating offline snapshot 5d5209a3-f6ce-4c13-b4f4-4545b868a4bb of volume 0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7107436-93d0-48a9-ac00-c5d6420d8fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07', 'volume_size': 1, 'snapshot_id': '35266f17-b33e-4aaa-92e0-77da485ca69e'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbc8236-0d8e-4198-8a97-81c13ee4a9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a12237-61cd-414e-a79d-b579f27fa8d8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Volume volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07 (b06e3bd3-ac18-430d-943c-ed7cb979ec07): created successfully
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbc8236-0d8e-4198-8a97-81c13ee4a9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Flow 'volume_create_manager' (c7e53bfb-5a95-48f0-a620-572bbe37d36b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:24:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-609a6bab-88e1-4a1d-9e87-ab97b6cd32f5 tempest-SnapshotDependencyTests-1818507951 None] Created volume successfully.
Aug 29 13:24:18 devstack sudo[101653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c
Aug 29 13:24:18 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:18 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c" returned: 0 in 0.357s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:18 devstack sudo[101658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb 1G
Aug 29 13:24:18 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:19 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb 1G" returned: 0 in 0.388s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f1059-727d-4e2c-8946-c4f669657d2c -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:19 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f1059-727d-4e2c-8946-c4f669657d2c -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb
Aug 29 13:24:19 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:19 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f1059-727d-4e2c-8946-c4f669657d2c -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" returned: 0 in 0.270s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:19 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb is being set with open permissions: ugo+rw
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:19 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb
Aug 29 13:24:19 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "cinder-35266f17-b33e-4aaa-92e0-77da485ca69e-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-35266f17-b33e-4aaa-92e0-77da485ca69e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "cinder-quobyte-72b63871-8220-431e-879d-95653230042f" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-72b63871-8220-431e-879d-95653230042f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "cinder-quobyte-35266f17-b33e-4aaa-92e0-77da485ca69e" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:19 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" returned: 0 in 0.255s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-35266f17-b33e-4aaa-92e0-77da485ca69e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Deleting offline snapshot 35266f17-b33e-4aaa-92e0-77da485ca69e of volume 72b63871-8220-431e-879d-95653230042f {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] snapshot_file for this snap is: volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7997a1c1-6e79-477d-bf3c-b4547b829622]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:19 devstack sudo[101673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.info
Aug 29 13:24:19 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:19 devstack sudo[101672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e
Aug 29 13:24:19 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:19 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.info" returned: 0 in 0.243s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:19 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.info is being set with open permissions: ugo+rw
Aug 29 13:24:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:19 devstack sudo[101677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.info
Aug 29 13:24:19 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:20 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e" returned: 0 in 0.358s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b63871-8220-431e-879d-95653230042f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9065093a-306a-42c1-9f5c-1945abe56217]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:20 devstack sudo[101682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f
Aug 29 13:24:20 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:20 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.info" returned: 0 in 0.247s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:20 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-84b48af6-fbd0-4938-b905-a45667589cca tempest-VolumesSnapshotListTestJSON-129201184 None] Create snapshot completed successfully
Aug 29 13:24:20 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f" returned: 0 in 0.523s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:20 devstack sudo[101688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e
Aug 29 13:24:20 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:20 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e" returned: 0 in 0.321s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:20 devstack sudo[101693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e
Aug 29 13:24:20 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:21 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f.35266f17-b33e-4aaa-92e0-77da485ca69e" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-35266f17-b33e-4aaa-92e0-77da485ca69e" released by "_delete_snapshot" :: held 1.567s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-72b63871-8220-431e-879d-95653230042f" released by "delete_snapshot" :: held 1.595s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Created reservations ['45b763c0-495e-45f7-b606-36b0ad3ffcf9', '6d8e6ea5-6b06-44d9-a0dd-e90035fc36f3', 'e58e2fbd-58b2-4983-b0aa-b485ee77eeac', '49bb25fd-bbaf-4060-bc66-95dad2cd0e89'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Creating offline snapshot 9620af2b-9caf-4bb0-b168-95d78ab350a3 of volume 0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c70270b-f431-44f2-b992-9330bfe0fa2d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Delete snapshot completed successfully.
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-07c6b1b4-09d1-45ea-9631-be7d9499d102 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-35266f17-b33e-4aaa-92e0-77da485ca69e-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:21 devstack sudo[101696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb
Aug 29 13:24:21 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:21 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" returned: 0 in 0.359s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9f1059-727d-4e2c-8946-c4f669657d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "cinder-72b63871-8220-431e-879d-95653230042f-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:21 devstack sudo[101701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 1G
Aug 29 13:24:21 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-72b63871-8220-431e-879d-95653230042f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "cinder-quobyte-72b63871-8220-431e-879d-95653230042f" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-72b63871-8220-431e-879d-95653230042f" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed586ef7-bec7-45d3-ab69-1dbc27ea84c9]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:21 devstack sudo[101703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f
Aug 29 13:24:21 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:22 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 1G" returned: 0 in 0.421s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:22 devstack sudo[101708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3
Aug 29 13:24:22 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:22 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:22 devstack sudo[101713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f
Aug 29 13:24:22 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:22 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3" returned: 0 in 0.293s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:22 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 is being set with open permissions: ugo+rw
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:22 devstack sudo[101719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3
Aug 29 13:24:22 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:22 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-72b63871-8220-431e-879d-95653230042f" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-72b63871-8220-431e-879d-95653230042f" released by "delete_volume" :: held 0.683s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Created reservations ['e9104b32-905e-4615-a205-5fb289dda1ae', '27293881-b210-440a-b326-3d7915ed17ee', '6f147360-2523-430c-90df-73f29e06add3', '9a5c2b07-ec43-484f-8727-bedbf4adca1d'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:22 devstack sudo[101722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:24:22 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:22 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3" returned: 0 in 0.258s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.428s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-129d9b7a-f8ce-4b7f-b57b-00289167659c tempest-VolumesSnapshotListTestJSON-129201184 None] Create snapshot completed successfully
Aug 29 13:24:22 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.251s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:24:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Deleted volume successfully.
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-62090825-9499-4d89-aa9c-fe155fa092b4 tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-72b63871-8220-431e-879d-95653230042f-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "cinder-b06e3bd3-ac18-430d-943c-ed7cb979ec07-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-b06e3bd3-ac18-430d-943c-ed7cb979ec07-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "cinder-quobyte-b06e3bd3-ac18-430d-943c-ed7cb979ec07" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-b06e3bd3-ac18-430d-943c-ed7cb979ec07" acquired by "delete_volume" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a102be2e-3a7f-4e6a-a163-4ea05ca865d8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:23 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07
Aug 29 13:24:23 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:23 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07" returned: 0 in 0.351s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:23 devstack sudo[101732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07
Aug 29 13:24:23 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Creating offline snapshot a281dbd9-c201-4622-bae6-ae5544240cdd of volume 0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:24:23 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b06e3bd3-ac18-430d-943c-ed7cb979ec07" returned: 0 in 0.269s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b401d3e6-4af3-4c42-8dbd-13dba8cc5817]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-quobyte-b06e3bd3-ac18-430d-943c-ed7cb979ec07" released by "delete_volume" :: held 0.665s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Created reservations ['21703304-4e14-42e8-acb0-a3a119656108', 'e185f6c3-8efc-41fd-8ebb-f3465ce37cc6', 'a756d930-c61f-4c66-9066-dd4ab606d0eb', 'e89ce4be-5d46-4a2d-938b-0404b967a90c'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:24:23 devstack sudo[101735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3
Aug 29 13:24:23 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:23 devstack sudo[101737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:24:23 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:24 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3" returned: 0 in 0.391s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9f1059-727d-4e2c-8946-c4f669657d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:24 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.267s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:24:24 devstack sudo[101743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd 1G
Aug 29 13:24:24 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Deleted volume successfully.
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-59082a66-c949-4d70-a146-d1e43d40619a tempest-SnapshotDependencyTests-1818507951 None] Lock "cinder-b06e3bd3-ac18-430d-943c-ed7cb979ec07-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:24 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd 1G" returned: 0 in 0.478s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:24 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd
Aug 29 13:24:24 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:24 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd" returned: 0 in 0.302s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:24 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd is being set with open permissions: ugo+rw
Aug 29 13:24:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:24 devstack sudo[101754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd
Aug 29 13:24:24 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:25 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.523s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0edc666b-8803-4255-8083-b6a41ee10cda tempest-VolumesSnapshotListTestJSON-129201184 None] Create snapshot completed successfully
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-a281dbd9-c201-4622-bae6-ae5544240cdd-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-a281dbd9-c201-4622-bae6-ae5544240cdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-quobyte-a281dbd9-c201-4622-bae6-ae5544240cdd" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-a281dbd9-c201-4622-bae6-ae5544240cdd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Deleting offline snapshot a281dbd9-c201-4622-bae6-ae5544240cdd of volume 0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] snapshot_file for this snap is: volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d411710-a9ff-45df-8707-de40feba413a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:26 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd
Aug 29 13:24:26 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:26 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd" returned: 0 in 0.354s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9f1059-727d-4e2c-8946-c4f669657d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:27 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc0fa5-8fa7-4181-ac35-e9b46f1add3e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:27 devstack sudo[101802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3
Aug 29 13:24:27 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:27 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3" returned: 0 in 0.364s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9f1059-727d-4e2c-8946-c4f669657d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:27 devstack sudo[101807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd
Aug 29 13:24:27 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:27 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd" returned: 0 in 0.461s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:27 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd
Aug 29 13:24:27 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:28 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.a281dbd9-c201-4622-bae6-ae5544240cdd" returned: 0 in 0.268s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-a281dbd9-c201-4622-bae6-ae5544240cdd" released by "_delete_snapshot" :: held 1.543s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" released by "delete_snapshot" :: held 1.569s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Created reservations ['62b42783-f952-4e3a-8ded-326b7a6f617e', '1f906d67-129b-4571-b0e8-8868378aca36', '3c09a1cc-f19a-4ba2-a063-2315030c6a91', '802ad1a8-a52c-4a98-8b43-57836c36fe26'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:24:28 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Delete snapshot completed successfully.
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-937c582a-7a5c-45d1-9b63-394972222824 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-a281dbd9-c201-4622-bae6-ae5544240cdd-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-9620af2b-9caf-4bb0-b168-95d78ab350a3-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-9620af2b-9caf-4bb0-b168-95d78ab350a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-quobyte-9620af2b-9caf-4bb0-b168-95d78ab350a3" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-9620af2b-9caf-4bb0-b168-95d78ab350a3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Deleting offline snapshot 9620af2b-9caf-4bb0-b168-95d78ab350a3 of volume 0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] snapshot_file for this snap is: volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff078776-fa02-46b7-8647-f712fd1eee82]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:29 devstack sudo[101817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3
Aug 29 13:24:29 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:29 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3" returned: 0 in 0.375s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9f1059-727d-4e2c-8946-c4f669657d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd54bec-2086-410f-86a1-de5833e33c6f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:29 devstack sudo[101822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb
Aug 29 13:24:29 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:29 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" returned: 0 in 0.374s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9f1059-727d-4e2c-8946-c4f669657d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:29 devstack sudo[101828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3
Aug 29 13:24:29 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:30 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3" returned: 0 in 0.395s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:30 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3
Aug 29 13:24:30 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:30 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.9620af2b-9caf-4bb0-b168-95d78ab350a3" returned: 0 in 0.237s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-9620af2b-9caf-4bb0-b168-95d78ab350a3" released by "_delete_snapshot" :: held 1.495s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" released by "delete_snapshot" :: held 1.516s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:30 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Created reservations ['70880cc3-7186-4d5a-b481-f31c0bc04602', '09602478-b2a3-4e5d-bd62-f16dfccdf52e', 'faea9df7-8b74-4186-88b1-892da0f6ba2e', 'a94c5d0f-34e2-4882-9829-b63fe57431ed'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:24:30 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Delete snapshot completed successfully.
Aug 29 13:24:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f54f8fd-52e8-4735-b116-bd8fd7c987a9 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-9620af2b-9caf-4bb0-b168-95d78ab350a3-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-5d5209a3-f6ce-4c13-b4f4-4545b868a4bb-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-5d5209a3-f6ce-4c13-b4f4-4545b868a4bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-quobyte-5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Deleting offline snapshot 5d5209a3-f6ce-4c13-b4f4-4545b868a4bb of volume 0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] snapshot_file for this snap is: volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d34ee25-e374-42f2-939d-cc750c1f414b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:31 devstack sudo[101837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb
Aug 29 13:24:31 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:31 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" returned: 0 in 0.363s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9f1059-727d-4e2c-8946-c4f669657d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f609c6a-7db5-4c27-bc57-0c034c84ae30]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:31 devstack sudo[101842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c
Aug 29 13:24:31 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:31 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c" returned: 0 in 0.395s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:31 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb
Aug 29 13:24:31 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:32 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" returned: 0 in 0.357s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:32 devstack sudo[101854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb
Aug 29 13:24:32 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:32 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c.5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" returned: 0 in 0.268s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-5d5209a3-f6ce-4c13-b4f4-4545b868a4bb" released by "_delete_snapshot" :: held 1.485s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" released by "delete_snapshot" :: held 1.508s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:32 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Created reservations ['441a5121-16da-40f5-98ae-fde58abffcf7', '8a88eef7-c1ee-4bbf-9058-cedc7ad21a8e', '668876e8-4a93-473f-a6bb-eed13817cdab', 'cace181d-c9d8-4cc2-ac21-915fb8315885'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:24:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Delete snapshot completed successfully.
Aug 29 13:24:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9892a2c4-deec-4563-a0df-6b0c21d8a10a tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-5d5209a3-f6ce-4c13-b4f4-4545b868a4bb-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-0b9f1059-727d-4e2c-8946-c4f669657d2c-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-0b9f1059-727d-4e2c-8946-c4f669657d2c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:24:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:24:33 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9651fa-2389-4098-a106-9b665cdce54b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:24:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:33 devstack sudo[101859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c
Aug 29 13:24:33 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:33 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c" returned: 0 in 0.373s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:33 devstack sudo[101864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c
Aug 29 13:24:33 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:34 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0b9f1059-727d-4e2c-8946-c4f669657d2c" returned: 0 in 0.269s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-quobyte-0b9f1059-727d-4e2c-8946-c4f669657d2c" released by "delete_volume" :: held 0.706s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Created reservations ['5b959fa8-d487-49fe-a863-a9ce4d035d22', '22618a4b-bd78-4204-913f-3548e237beff', '57f9302b-3227-4c8a-9e65-fa209878db60', '7dd61e4f-9bf2-4ff8-856a-3dd627ac51e0'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:34 devstack sudo[101867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:24:34 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:34 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:24:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Deleted volume successfully.
Aug 29 13:24:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d2fe09a9-55fd-4e57-b91b-2cdd42a2a290 tempest-VolumesSnapshotListTestJSON-129201184 None] Lock "cinder-0b9f1059-727d-4e2c-8946-c4f669657d2c-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:24:44 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=50,cinder:INSERT=15,cinder:UPDATE=54,cinder:DELETE=2 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:24:44 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=39,cinder:UPDATE=49,cinder:DELETE=5,cinder:INSERT=15 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:24:54 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:24:54 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:24:54 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.321s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:24:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Flow 'volume_create_manager' (fa4fabdb-e04a-464f-ae6c-4f5433edf6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710da749-9cac-4890-b02f-8060b08872c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710da749-9cac-4890-b02f-8060b08872c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-636119351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=815b8620-517b-4ef9-9ad9-f828a91c361e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d6c1803c6c4de2b94cb9d808aba474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:25:06Z,use_quota=True,user_id='c2a79c7b43f242d3acce1b8cd8540aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfc77b4-5730-4ab5-a927-61c6e28cc8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfc77b4-5730-4ab5-a927-61c6e28cc8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de70d79c-9b68-4f15-bc3a-75939b4a94e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de70d79c-9b68-4f15-bc3a-75939b4a94e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '815b8620-517b-4ef9-9ad9-f828a91c361e', 'volume_name': 'volume-815b8620-517b-4ef9-9ad9-f828a91c361e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d20fd09-0c73-4f11-aa49-d64b75dc2535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d20fd09-0c73-4f11-aa49-d64b75dc2535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef942eaf-f4b2-4236-be8a-aa5ea788ced2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:25:06 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Volume 815b8620-517b-4ef9-9ad9-f828a91c361e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-815b8620-517b-4ef9-9ad9-f828a91c361e', 'volume_size': 1}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-636119351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=815b8620-517b-4ef9-9ad9-f828a91c361e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d6c1803c6c4de2b94cb9d808aba474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:25:06Z,use_quota=True,user_id='c2a79c7b43f242d3acce1b8cd8540aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Creating volume 815b8620-517b-4ef9-9ad9-f828a91c361e {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:25:06 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:25:06 devstack sudo[102316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e 1073741824
Aug 29 13:25:06 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:25:06 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e 1073741824" returned: 0 in 0.417s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:25:06 devstack sudo[102321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e
Aug 29 13:25:06 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:25:06 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e" returned: 0 in 0.247s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef942eaf-f4b2-4236-be8a-aa5ea788ced2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-815b8620-517b-4ef9-9ad9-f828a91c361e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e0be37-6dfc-4ffb-8e53-ccf07cd387cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:25:06 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Volume volume-815b8620-517b-4ef9-9ad9-f828a91c361e (815b8620-517b-4ef9-9ad9-f828a91c361e): created successfully
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e0be37-6dfc-4ffb-8e53-ccf07cd387cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:25:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Flow 'volume_create_manager' (fa4fabdb-e04a-464f-ae6c-4f5433edf6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:25:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5c4930b9-b970-4501-926a-3f16f33455c2 tempest-TestMinimumBasicScenario-1044164550 None] Created volume successfully.
Aug 29 13:25:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-cdcda123-abbd-4400-8c52-6c7d53aef12d req-3635a6f2-33a9-40c5-bb6c-1af0a071944c tempest-TestMinimumBasicScenario-1044164550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:25:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-cdcda123-abbd-4400-8c52-6c7d53aef12d req-3635a6f2-33a9-40c5-bb6c-1af0a071944c tempest-TestMinimumBasicScenario-1044164550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:25:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-cdcda123-abbd-4400-8c52-6c7d53aef12d req-3635a6f2-33a9-40c5-bb6c-1af0a071944c tempest-TestMinimumBasicScenario-1044164550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:25:07 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-cdcda123-abbd-4400-8c52-6c7d53aef12d req-3635a6f2-33a9-40c5-bb6c-1af0a071944c tempest-TestMinimumBasicScenario-1044164550 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-815b8620-517b-4ef9-9ad9-f828a91c361e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd35405a-d87e-4f22-9e91-0daeff08bd19', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:25:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-cdcda123-abbd-4400-8c52-6c7d53aef12d req-3635a6f2-33a9-40c5-bb6c-1af0a071944c tempest-TestMinimumBasicScenario-1044164550 None] attachment_update completed successfully.
Aug 29 13:25:17 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:25:17 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:25:54 devstack sudo[102950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:25:54 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:25:54 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.238s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:25:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:26:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-4be010ab-de8d-413a-944d-98912fe66e4b req-ced8feb1-7215-41af-af3a-8c0e0a5b63aa tempest-TestMinimumBasicScenario-1044164550 None] Terminate volume connection completed successfully.
Aug 29 13:26:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-4be010ab-de8d-413a-944d-98912fe66e4b req-ced8feb1-7215-41af-af3a-8c0e0a5b63aa tempest-TestMinimumBasicScenario-1044164550 None] Deleting attachment fd35405a-d87e-4f22-9e91-0daeff08bd19. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:26:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Acquiring lock "cinder-815b8620-517b-4ef9-9ad9-f828a91c361e-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:26:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Lock "cinder-815b8620-517b-4ef9-9ad9-f828a91c361e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:26:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Acquiring lock "cinder-quobyte-815b8620-517b-4ef9-9ad9-f828a91c361e" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:26:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Lock "cinder-quobyte-815b8620-517b-4ef9-9ad9-f828a91c361e" acquired by "delete_volume" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:26:10 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[161a9e67-5f52-49ca-9800-3206c9f003f6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:26:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:26:10 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e
Aug 29 13:26:10 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:26:11 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e" returned: 0 in 0.346s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:26:11 devstack sudo[102971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e
Aug 29 13:26:11 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:26:11 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-815b8620-517b-4ef9-9ad9-f828a91c361e" returned: 0 in 0.257s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Lock "cinder-quobyte-815b8620-517b-4ef9-9ad9-f828a91c361e" released by "delete_volume" :: held 0.638s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Created reservations ['01a1246e-ed94-4534-be0a-6b9096853cd5', 'aeedb600-e539-4950-a1e6-93e354667da3', '94e7149d-fd3f-48f8-ab6f-47ab11f7464f', 'f22dc620-10df-40fc-91c8-f2146d357399'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:26:11 devstack sudo[102974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:26:11 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:26:11 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.251s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:26:11 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Deleted volume successfully.
Aug 29 13:26:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-61fb102d-ebbb-44ba-bce5-d42f15dc26ed tempest-TestMinimumBasicScenario-1044164550 None] Lock "cinder-815b8620-517b-4ef9-9ad9-f828a91c361e-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:26:21 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:26:21 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:26:36 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:26:54 devstack sudo[103146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:26:54 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:26:54 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.242s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:26:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Flow 'volume_create_manager' (bf87ee04-37dc-4ee8-b768-c29fe0ad2d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f59cbb-1c34-4832-8e20-658ba86d7ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f59cbb-1c34-4832-8e20-658ba86d7ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2005575594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69005ac1-a46a-4fa0-bcec-3360d83910ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934a2d2b7356498a9eafee22d08fbf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:27:14Z,use_quota=True,user_id='c3a82e329a9d4130b7fe05d33ed41363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77db2fbe-bc69-4d04-bda0-683a531b369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77db2fbe-bc69-4d04-bda0-683a531b369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5f574c-4407-4722-8d0f-4aeff90b1c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5f574c-4407-4722-8d0f-4aeff90b1c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69005ac1-a46a-4fa0-bcec-3360d83910ff', 'volume_name': 'volume-69005ac1-a46a-4fa0-bcec-3360d83910ff', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c94276-e6a5-4112-8b51-636928931537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c94276-e6a5-4112-8b51-636928931537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba06ddf-e667-4ed5-beb6-37c1bc9cea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:14 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Volume 69005ac1-a46a-4fa0-bcec-3360d83910ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69005ac1-a46a-4fa0-bcec-3360d83910ff', 'volume_size': 1}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2005575594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69005ac1-a46a-4fa0-bcec-3360d83910ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934a2d2b7356498a9eafee22d08fbf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:27:14Z,use_quota=True,user_id='c3a82e329a9d4130b7fe05d33ed41363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Creating volume 69005ac1-a46a-4fa0-bcec-3360d83910ff {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:27:14 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:14 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff 1073741824
Aug 29 13:27:14 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:14 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff 1073741824" returned: 0 in 0.388s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:14 devstack sudo[103172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff
Aug 29 13:27:14 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:14 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff" returned: 0 in 0.239s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba06ddf-e667-4ed5-beb6-37c1bc9cea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69005ac1-a46a-4fa0-bcec-3360d83910ff', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ef9973-ad03-4d92-be96-3bfab3630383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:15 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Volume volume-69005ac1-a46a-4fa0-bcec-3360d83910ff (69005ac1-a46a-4fa0-bcec-3360d83910ff): created successfully
Aug 29 13:27:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ef9973-ad03-4d92-be96-3bfab3630383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Flow 'volume_create_manager' (bf87ee04-37dc-4ee8-b768-c29fe0ad2d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:27:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0a0699ab-4fd3-4be9-b4c9-251e705555aa tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Created volume successfully.
Aug 29 13:27:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-39871ed5-1d3e-4381-b476-f4a3ed4eb9f8 req-e92bdf55-418b-495e-b005-82878941cf8f tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:27:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-39871ed5-1d3e-4381-b476-f4a3ed4eb9f8 req-e92bdf55-418b-495e-b005-82878941cf8f tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:27:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [req-39871ed5-1d3e-4381-b476-f4a3ed4eb9f8 req-e92bdf55-418b-495e-b005-82878941cf8f tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:27:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-39871ed5-1d3e-4381-b476-f4a3ed4eb9f8 req-e92bdf55-418b-495e-b005-82878941cf8f tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e', 'name': 'volume-69005ac1-a46a-4fa0-bcec-3360d83910ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0873343-2195-48ed-8fc0-4329f6272ab2', 'enforce_multipath': True} {{(pid=85771) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 29 13:27:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-39871ed5-1d3e-4381-b476-f4a3ed4eb9f8 req-e92bdf55-418b-495e-b005-82878941cf8f tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] attachment_update completed successfully.
Aug 29 13:27:17 devstack cinder-volume[85771]: INFO cinder.volume.manager [req-a1dcd255-4b92-4482-994b-efacc2a0d3c7 req-51bd2243-6ada-411c-b1b7-b03bd7b8c683 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Terminate volume connection completed successfully.
Aug 29 13:27:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [req-a1dcd255-4b92-4482-994b-efacc2a0d3c7 req-51bd2243-6ada-411c-b1b7-b03bd7b8c683 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Deleting attachment b0873343-2195-48ed-8fc0-4329f6272ab2. {{(pid=85771) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 29 13:27:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Acquiring lock "cinder-69005ac1-a46a-4fa0-bcec-3360d83910ff-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:27:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "cinder-69005ac1-a46a-4fa0-bcec-3360d83910ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:27:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Acquiring lock "cinder-quobyte-69005ac1-a46a-4fa0-bcec-3360d83910ff" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:27:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "cinder-quobyte-69005ac1-a46a-4fa0-bcec-3360d83910ff" acquired by "delete_volume" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:27:18 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7134ba-ccb6-4ba1-861a-6bed536b3621]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:27:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:18 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff
Aug 29 13:27:18 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:19 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff" returned: 0 in 0.351s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:19 devstack sudo[103599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff
Aug 29 13:27:19 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:19 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-69005ac1-a46a-4fa0-bcec-3360d83910ff" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "cinder-quobyte-69005ac1-a46a-4fa0-bcec-3360d83910ff" released by "delete_volume" :: held 0.637s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Created reservations ['4be9ceed-bb41-40a5-8ab0-92d3c85dfba2', 'e63d4f34-7459-4c8b-bbcf-4c98d809a0e8', 'd116b416-ef68-490c-b937-e11b1069dd0f', '43d55fb4-0b08-4f8b-ae68-346ae3e436c8'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:19 devstack sudo[103602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:27:19 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:19 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.239s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:27:19 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Deleted volume successfully.
Aug 29 13:27:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96c5a08d-bc12-4111-91a5-83568794f6b5 tempest-TestServerVolumeAttachScenarioOldVersion-271160324 None] Lock "cinder-69005ac1-a46a-4fa0-bcec-3360d83910ff-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:27:29 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:27:29 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=13,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=3 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Flow 'volume_create_manager' (e9a75257-07fd-4c3b-87fb-133c938bac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdcab5b-ad82-4328-9380-9cef8a5ae04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdcab5b-ad82-4328-9380-9cef8a5ae04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-700301399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb74185-e787-4b9c-bcf1-6692a044ad16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af6c870362c4e5ca8a31cf7d1f10eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:27:53Z,use_quota=True,user_id='1b2ee48252a542a69fd2c22b88bc3f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca75c57d-dc44-4c54-9aa2-1df4abe6a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca75c57d-dc44-4c54-9aa2-1df4abe6a814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0be694-5889-4fda-8273-2a7c97f783b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0be694-5889-4fda-8273-2a7c97f783b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb74185-e787-4b9c-bcf1-6692a044ad16', 'volume_name': 'volume-0bb74185-e787-4b9c-bcf1-6692a044ad16', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98129061-3285-42a9-943e-45289bf2f6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98129061-3285-42a9-943e-45289bf2f6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75cb80d-773d-4229-aed2-0f87ebdacee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Volume 0bb74185-e787-4b9c-bcf1-6692a044ad16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb74185-e787-4b9c-bcf1-6692a044ad16', 'volume_size': 1}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-700301399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb74185-e787-4b9c-bcf1-6692a044ad16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af6c870362c4e5ca8a31cf7d1f10eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:27:53Z,use_quota=True,user_id='1b2ee48252a542a69fd2c22b88bc3f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Creating volume 0bb74185-e787-4b9c-bcf1-6692a044ad16 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:27:52 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:27:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:52 devstack sudo[103685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 1073741824
Aug 29 13:27:52 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:53 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 1073741824" returned: 0 in 0.401s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:53 devstack sudo[103692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16
Aug 29 13:27:53 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:53 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16" returned: 0 in 0.239s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:27:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:27:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75cb80d-773d-4229-aed2-0f87ebdacee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb74185-e787-4b9c-bcf1-6692a044ad16', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0af946-4e22-49d2-9bb3-6408999aa1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:27:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Volume volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 (0bb74185-e787-4b9c-bcf1-6692a044ad16): created successfully
Aug 29 13:27:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0af946-4e22-49d2-9bb3-6408999aa1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:27:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Flow 'volume_create_manager' (e9a75257-07fd-4c3b-87fb-133c938bac8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:27:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-07932a54-dbf5-402d-8bb8-b4c732b05474 tempest-TestImageHashVerification-1643291650 None] Created volume successfully.
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b6c53a-b053-45e0-904f-7f6d14ec6c24]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:54 devstack sudo[103697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:27:54 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:54 devstack sudo[103696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16
Aug 29 13:27:54 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:54 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:27:54 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16" returned: 0 in 0.368s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:55 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[392384df-f1a7-40c6-b5df-7eca805b91fa]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:27:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:55 devstack sudo[103704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16
Aug 29 13:27:55 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:55 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16" returned: 0 in 0.357s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 /opt/stack/data/cinder/conversion/0bb74185-e787-4b9c-bcf1-6692a044ad16.temp_image.10b9f878-8af1-42f4-9332-b7fe14a37d675mac1k6n.img {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:55 devstack sudo[103709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 /opt/stack/data/cinder/conversion/0bb74185-e787-4b9c-bcf1-6692a044ad16.temp_image.10b9f878-8af1-42f4-9332-b7fe14a37d675mac1k6n.img
Aug 29 13:27:55 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:59 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 /opt/stack/data/cinder/conversion/0bb74185-e787-4b9c-bcf1-6692a044ad16.temp_image.10b9f878-8af1-42f4-9332-b7fe14a37d675mac1k6n.img" returned: 0 in 3.840s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:59 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa7b750-c8e4-4465-9388-f93803b4be0a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:27:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:27:59 devstack sudo[103721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16
Aug 29 13:27:59 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:27:59 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root
Aug 29 13:27:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16" returned: 0 in 0.518s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:27:59 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/conversion/0bb74185-e787-4b9c-bcf1-6692a044ad16.temp_image.10b9f878-8af1-42f4-9332-b7fe14a37d675mac1k6n.img {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:27:59 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Converted 1024.00 MB image at 266.51 MB/s
Aug 29 13:27:59 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] 10b9f878-8af1-42f4-9332-b7fe14a37d67 was raw, no need to convert to raw {{(pid=85771) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 29 13:28:09 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:28:09 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:28:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.075s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Uploaded volume to glance image-id: 10b9f878-8af1-42f4-9332-b7fe14a37d67. {{(pid=85771) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 29 13:28:17 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b922dca4-5f3b-4ed7-b163-bc9f64f65758 tempest-TestImageHashVerification-1643291650 None] Copy volume to image completed successfully.
Aug 29 13:28:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Acquiring lock "cinder-0bb74185-e787-4b9c-bcf1-6692a044ad16-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Lock "cinder-0bb74185-e787-4b9c-bcf1-6692a044ad16-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Acquiring lock "cinder-quobyte-0bb74185-e787-4b9c-bcf1-6692a044ad16" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Lock "cinder-quobyte-0bb74185-e787-4b9c-bcf1-6692a044ad16" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f776d08-43f9-4062-b8f8-b3b772efdbf6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:19 devstack sudo[103728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16
Aug 29 13:28:19 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:19 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16" returned: 0 in 0.349s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:19 devstack sudo[103733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16
Aug 29 13:28:19 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:19 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0bb74185-e787-4b9c-bcf1-6692a044ad16" returned: 0 in 0.239s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Lock "cinder-quobyte-0bb74185-e787-4b9c-bcf1-6692a044ad16" released by "delete_volume" :: held 0.627s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Created reservations ['5863eebd-f448-4680-81d0-8de859a16385', '15369c0a-739e-42f0-bc93-0d3d7f1d83f6', '1329e41a-44e8-4ba4-a0fb-720270453ab7', '5deda72e-5b79-4d1e-8c02-dda6044fb282'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:19 devstack sudo[103736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:28:19 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:19 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.235s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:20 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:28:20 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Deleted volume successfully.
Aug 29 13:28:20 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-743382b8-263b-4093-a237-6aec8d18dea6 tempest-TestImageHashVerification-1643291650 None] Lock "cinder-0bb74185-e787-4b9c-bcf1-6692a044ad16-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Flow 'volume_create_manager' (016e76d6-b973-484b-9c39-e173f8acd2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb656e87-eb5a-4fa6-81a4-26585e458e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb656e87-eb5a-4fa6-81a4-26585e458e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a16c077-053e-4c54-b0c4-6b13545b12ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30944e2855e449b6aec7e9dc1b2026d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:34Z,use_quota=True,user_id='75a5fd2815834942b6c519d12b17f08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dec1278e-6f2f-4fb7-a182-cc10f365f765),volume_type_id=dec1278e-6f2f-4fb7-a182-cc10f365f765)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d393829-0c72-4459-8f5f-c73ffb138cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d393829-0c72-4459-8f5f-c73ffb138cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c842c7-177e-4a1d-a6b2-6fcf80aae26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c842c7-177e-4a1d-a6b2-6fcf80aae26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a16c077-053e-4c54-b0c4-6b13545b12ca', 'volume_name': 'volume-0a16c077-053e-4c54-b0c4-6b13545b12ca', 'volume_size': 1, 'image_id': '6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d3ff25d134eef1c9e4119b340426021', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30944e2855e449b6aec7e9dc1b2026d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54385d86fd80d932e0e1495b2ca00b39aed2328ef2b814984ade573a0a36a34eb1e3feb87d12f823b39925fca2b71bcef1ed4592bbe2d4dcb17ac67c7b410502', 'id': '6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'created_at': datetime.datetime(2026, 8, 29, 11, 28, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 28, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dc16e32-2f0a-4ca0-a928-b8429f7e71c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b62078e900>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00df6c63-efb0-46da-b3cc-6d8c04a15756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00df6c63-efb0-46da-b3cc-6d8c04a15756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fbba0a-b742-4bb9-a399-2cd43a8fdac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:33 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Volume 0a16c077-053e-4c54-b0c4-6b13545b12ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a16c077-053e-4c54-b0c4-6b13545b12ca', 'volume_size': 1, 'image_id': '6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d3ff25d134eef1c9e4119b340426021', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30944e2855e449b6aec7e9dc1b2026d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54385d86fd80d932e0e1495b2ca00b39aed2328ef2b814984ade573a0a36a34eb1e3feb87d12f823b39925fca2b71bcef1ed4592bbe2d4dcb17ac67c7b410502', 'id': '6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'created_at': datetime.datetime(2026, 8, 29, 11, 28, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 28, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dc16e32-2f0a-4ca0-a928-b8429f7e71c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b62078e900>}
Aug 29 13:28:33 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Trying to clone 0a16c077-053e-4c54-b0c4-6b13545b12ca from image 6dc16e32-2f0a-4ca0-a928-b8429f7e71c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:28:34 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Image download 0.00 MB at 0.00 MB/s
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd05e203-13ce-4c75-952d-e14b41507253]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:34 devstack sudo[103785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD
Aug 29 13:28:34 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:34 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:34 devstack sudo[103789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD
Aug 29 13:28:34 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:34 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Temporary image 6dc16e32-2f0a-4ca0-a928-b8429f7e71c5 is fetched for user 75a5fd2815834942b6c519d12b17f08c. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[129b0501-1f9e-4a24-a1dd-e968ec7137a3]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:34 devstack sudo[103794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD
Aug 29 13:28:34 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:35 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:35 devstack sudo[103798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD
Aug 29 13:28:35 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:35 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a16c077-053e-4c54-b0c4-6b13545b12ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30944e2855e449b6aec7e9dc1b2026d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:34Z,use_quota=True,user_id='75a5fd2815834942b6c519d12b17f08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dec1278e-6f2f-4fb7-a182-cc10f365f765),volume_type_id=dec1278e-6f2f-4fb7-a182-cc10f365f765)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Creating volume 0a16c077-053e-4c54-b0c4-6b13545b12ca {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:28:35 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:35 devstack sudo[103803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca 1073741824
Aug 29 13:28:35 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:35 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca 1073741824" returned: 0 in 0.400s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:35 devstack sudo[103808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca
Aug 29 13:28:35 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:36 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca" returned: 0 in 0.245s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Attempting download of 6dc16e32-2f0a-4ca0-a928-b8429f7e71c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'metadata': {}}])) to volume 0a16c077-053e-4c54-b0c4-6b13545b12ca. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f485edd-8be0-4404-8662-d4bf89419dd4]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_hdhct1hb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:36 devstack sudo[103811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_hdhct1hb
Aug 29 13:28:36 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:36 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_hdhct1hb" returned: 0 in 0.321s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_hdhct1hb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:36 devstack sudo[103815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_hdhct1hb
Aug 29 13:28:36 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:36 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_hdhct1hb" returned: 1 in 0.322s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_hdhct1hb' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c296c42-262d-40db-8c99-4aa468d3015f]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:36 devstack sudo[103819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD
Aug 29 13:28:36 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:37 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:37 devstack sudo[103823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD
Aug 29 13:28:37 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:37 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:28:37 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] 6dc16e32-2f0a-4ca0-a928-b8429f7e71c5 was raw, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:28:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:37 devstack sudo[103828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca
Aug 29 13:28:37 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:37 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca" returned: 0 in 0.419s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:37 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dc16e32-2f0a-4ca0-a928-b8429f7e71c5_9m0opvrqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:28:37 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Converted 0.00 MB image at 0.00 MB/s
Aug 29 13:28:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:37 devstack sudo[103834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca 1G
Aug 29 13:28:37 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:38 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca 1G" returned: 0 in 0.303s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Downloaded image 6dc16e32-2f0a-4ca0-a928-b8429f7e71c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'metadata': {}}])) to volume 0a16c077-053e-4c54-b0c4-6b13545b12ca successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Temporary image 6dc16e32-2f0a-4ca0-a928-b8429f7e71c5 for user 75a5fd2815834942b6c519d12b17f08c is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Marking volume 0a16c077-053e-4c54-b0c4-6b13545b12ca as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Copying metadata from image 6dc16e32-2f0a-4ca0-a928-b8429f7e71c5 to 0a16c077-053e-4c54-b0c4-6b13545b12ca. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Creating volume glance metadata for volume 0a16c077-053e-4c54-b0c4-6b13545b12ca backed by image 6dc16e32-2f0a-4ca0-a928-b8429f7e71c5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4d3ff25d134eef1c9e4119b340426021', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fbba0a-b742-4bb9-a399-2cd43a8fdac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a16c077-053e-4c54-b0c4-6b13545b12ca', 'volume_size': 1, 'image_id': '6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d3ff25d134eef1c9e4119b340426021', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30944e2855e449b6aec7e9dc1b2026d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54385d86fd80d932e0e1495b2ca00b39aed2328ef2b814984ade573a0a36a34eb1e3feb87d12f823b39925fca2b71bcef1ed4592bbe2d4dcb17ac67c7b410502', 'id': '6dc16e32-2f0a-4ca0-a928-b8429f7e71c5', 'created_at': datetime.datetime(2026, 8, 29, 11, 28, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 28, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dc16e32-2f0a-4ca0-a928-b8429f7e71c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b62078e900>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b9f017-b2ad-41ce-8a26-ac06fafc67ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:38 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Volume volume-0a16c077-053e-4c54-b0c4-6b13545b12ca (0a16c077-053e-4c54-b0c4-6b13545b12ca): created successfully
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b9f017-b2ad-41ce-8a26-ac06fafc67ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Flow 'volume_create_manager' (016e76d6-b973-484b-9c39-e173f8acd2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1a8c6083-b9ed-452a-b066-a7b234bd4acc tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Created volume successfully.
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Acquiring lock "cinder-0a16c077-053e-4c54-b0c4-6b13545b12ca-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "cinder-0a16c077-053e-4c54-b0c4-6b13545b12ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Acquiring lock "cinder-quobyte-0a16c077-053e-4c54-b0c4-6b13545b12ca" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "cinder-quobyte-0a16c077-053e-4c54-b0c4-6b13545b12ca" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4111efc-7e13-40a3-a55e-6fcd4ee4a522]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:39 devstack sudo[103839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca
Aug 29 13:28:39 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:39 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca" returned: 0 in 0.376s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:39 devstack sudo[103844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca
Aug 29 13:28:39 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:39 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a16c077-053e-4c54-b0c4-6b13545b12ca" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "cinder-quobyte-0a16c077-053e-4c54-b0c4-6b13545b12ca" released by "delete_volume" :: held 0.658s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:39 devstack cinder-volume[85771]: WARNING cinder.quota [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:28:39 devstack cinder-volume[85771]: WARNING cinder.quota [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Created reservations ['c0d83532-7eff-44b2-b1e9-75d2eec9c86b', '5f420149-2141-4f41-b161-fc27145052e9', 'd5caea2f-3c5a-4d76-9ba2-17cd83d0b244', '35912b33-3468-44a0-bd5f-5c87779141dd'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:39 devstack sudo[103847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:28:39 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:39 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.249s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:28:39 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Deleted volume successfully.
Aug 29 13:28:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c69c2d60-0100-4f9e-90c0-7d368ce14302 tempest-VolumeAndVolumeTypeFromImageTest-476122731 None] Lock "cinder-0a16c077-053e-4c54-b0c4-6b13545b12ca-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (e4eaa299-cfd3-4dd4-b9cd-1ac466f01aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7261af7b-ee7e-4d5f-97a4-67ded4066ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7261af7b-ee7e-4d5f-97a4-67ded4066ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602478704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0104858f-8119-4f30-bc71-ec4d4c2f1a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:44Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3ea525-e999-43e7-9345-27439c27cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3ea525-e999-43e7-9345-27439c27cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d7821e-5ba0-4f34-957a-4919448e0548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d7821e-5ba0-4f34-957a-4919448e0548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0104858f-8119-4f30-bc71-ec4d4c2f1a63', 'volume_name': 'volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b2352c-01d2-4f79-8e7e-3d72d9d3929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b2352c-01d2-4f79-8e7e-3d72d9d3929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b60b6b-50b0-4206-9f8e-44cb3ebe770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:44 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume 0104858f-8119-4f30-bc71-ec4d4c2f1a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63', 'volume_size': 1}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602478704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0104858f-8119-4f30-bc71-ec4d4c2f1a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:44Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Creating volume 0104858f-8119-4f30-bc71-ec4d4c2f1a63 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:28:44 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:44 devstack sudo[103858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63 1073741824
Aug 29 13:28:44 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:44 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63 1073741824" returned: 0 in 0.433s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:44 devstack sudo[103865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63
Aug 29 13:28:44 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:44 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63" returned: 0 in 0.252s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b60b6b-50b0-4206-9f8e-44cb3ebe770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb9d7cd-f250-4455-8e2d-8dd31e528b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:44 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63 (0104858f-8119-4f30-bc71-ec4d4c2f1a63): created successfully
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb9d7cd-f250-4455-8e2d-8dd31e528b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (e4eaa299-cfd3-4dd4-b9cd-1ac466f01aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:44 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-25476802-3fe2-45de-a556-c4e5391c204d tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created volume successfully.
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (f0337b7a-3617-4558-a893-00bcf7396625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a0e9e3-a92a-421b-974f-f40ac731142d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a0e9e3-a92a-421b-974f-f40ac731142d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1379556095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59debaa-90c5-4833-80d9-fe71d2d7a92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:45Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4b2386-3662-47a9-9495-ac308a46dabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4b2386-3662-47a9-9495-ac308a46dabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407214b3-f79f-4ef5-b8fa-37215fc680a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407214b3-f79f-4ef5-b8fa-37215fc680a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59debaa-90c5-4833-80d9-fe71d2d7a92f', 'volume_name': 'volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af07945-9c48-4695-b6b7-f90b51df56d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af07945-9c48-4695-b6b7-f90b51df56d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941d421d-305e-4e44-9af6-5e38ef30d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume a59debaa-90c5-4833-80d9-fe71d2d7a92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f', 'volume_size': 1}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1379556095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59debaa-90c5-4833-80d9-fe71d2d7a92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:45Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Creating volume a59debaa-90c5-4833-80d9-fe71d2d7a92f {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:28:45 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:45 devstack sudo[103868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f 1073741824
Aug 29 13:28:45 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (45065353-74b6-4295-8353-24d8babd1707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c608a082-c4a3-4c60-b7ef-a6a52bfca944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c608a082-c4a3-4c60-b7ef-a6a52bfca944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-996326932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:46Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d6a69f-7e8a-4746-adc1-5f220a1907d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d6a69f-7e8a-4746-adc1-5f220a1907d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce06f95-0b4e-46aa-9042-3f0769c89c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce06f95-0b4e-46aa-9042-3f0769c89c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9', 'volume_name': 'volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683b61d1-6010-448a-a244-018b429aad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683b61d1-6010-448a-a244-018b429aad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99836ba4-b9ca-401e-b1d5-03271b4bd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:45 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9', 'volume_size': 1}
Aug 29 13:28:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:46 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f 1073741824" returned: 0 in 0.459s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:46 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f
Aug 29 13:28:46 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (f21f7f6e-0c8c-4378-ba53-6564b438eced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8819317e-66f0-4ac9-89ed-3f8fb25b6284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8819317e-66f0-4ac9-89ed-3f8fb25b6284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889719690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234d2a4e-c987-46b7-b6e8-168ed1407d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:46Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cf67fc-b7ce-49e2-beb8-c1d6ca86173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cf67fc-b7ce-49e2-beb8-c1d6ca86173d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32ddf83-526b-4f97-97de-b1b26656ee1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32ddf83-526b-4f97-97de-b1b26656ee1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234d2a4e-c987-46b7-b6e8-168ed1407d45', 'volume_name': 'volume-234d2a4e-c987-46b7-b6e8-168ed1407d45', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e43079-c994-4946-8a84-2bc2ebd4f704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e43079-c994-4946-8a84-2bc2ebd4f704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9287be-194b-4d72-a832-3fc22bce8d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume 234d2a4e-c987-46b7-b6e8-168ed1407d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234d2a4e-c987-46b7-b6e8-168ed1407d45', 'volume_size': 1}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:46 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f" returned: 0 in 0.296s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-996326932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:46Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Creating volume a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:28:46 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941d421d-305e-4e44-9af6-5e38ef30d10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c961cc21-7d46-4449-b918-612f2b066228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack sudo[103877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9 1073741824
Aug 29 13:28:46 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:46 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f (a59debaa-90c5-4833-80d9-fe71d2d7a92f): created successfully
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c961cc21-7d46-4449-b918-612f2b066228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (f0337b7a-3617-4558-a893-00bcf7396625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:46 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-998b8038-863e-449d-af7b-1cb47f90f3ea tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created volume successfully.
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (1b989433-0d27-48a3-a72f-6c1553912ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cac746-5530-44b2-adde-fdce9285caa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cac746-5530-44b2-adde-fdce9285caa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872973076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e0cf56-b3ea-4fc1-ba48-1dc08acf674a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:47Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ec201d-69a0-47bf-a24b-70b7e9a842b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ec201d-69a0-47bf-a24b-70b7e9a842b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472a3bd5-d707-4982-a35a-71b3723a5d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472a3bd5-d707-4982-a35a-71b3723a5d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e0cf56-b3ea-4fc1-ba48-1dc08acf674a', 'volume_name': 'volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1924c7-6abc-4f9e-bdca-4b2693e1fd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1924c7-6abc-4f9e-bdca-4b2693e1fd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb30654d-0ab0-47f7-a575-9edceb6128b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume 49e0cf56-b3ea-4fc1-ba48-1dc08acf674a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a', 'volume_size': 1}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:46 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9 1073741824" returned: 0 in 0.466s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:46 devstack sudo[103883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9
Aug 29 13:28:46 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (9b3384f6-45d4-4c53-b104-3fde5629aaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409f2786-2fd1-43d3-a98d-ce68e7ba523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409f2786-2fd1-43d3-a98d-ce68e7ba523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-94574599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106e2590-e7d4-4e51-9d47-bc3e020a727d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:47Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4506232-b232-419b-8e21-c2ccf732ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4506232-b232-419b-8e21-c2ccf732ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2ffca5-3a34-423c-9f0a-a51fe1c97bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2ffca5-3a34-423c-9f0a-a51fe1c97bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106e2590-e7d4-4e51-9d47-bc3e020a727d', 'volume_name': 'volume-106e2590-e7d4-4e51-9d47-bc3e020a727d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85abd393-ad07-4ed0-bcc2-8796402f4e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85abd393-ad07-4ed0-bcc2-8796402f4e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0d7ff1-4732-49f5-afd2-2dd29ca714e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:47 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume 106e2590-e7d4-4e51-9d47-bc3e020a727d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106e2590-e7d4-4e51-9d47-bc3e020a727d', 'volume_size': 1}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:47 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9" returned: 0 in 0.247s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889719690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234d2a4e-c987-46b7-b6e8-168ed1407d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:46Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Creating volume 234d2a4e-c987-46b7-b6e8-168ed1407d45 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:28:47 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99836ba4-b9ca-401e-b1d5-03271b4bd041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:47 devstack sudo[103887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45 1073741824
Aug 29 13:28:47 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee08224-2327-492a-bbbd-761f6ab130e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:47 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9 (a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9): created successfully
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee08224-2327-492a-bbbd-761f6ab130e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (45065353-74b6-4295-8353-24d8babd1707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:47 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-47b9d3d8-26e9-4e7a-bdc0-4f3617afc513 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created volume successfully.
Aug 29 13:28:47 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45 1073741824" returned: 0 in 0.399s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:47 devstack sudo[103893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45
Aug 29 13:28:47 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:47 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45" returned: 0 in 0.236s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872973076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e0cf56-b3ea-4fc1-ba48-1dc08acf674a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:47Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Creating volume 49e0cf56-b3ea-4fc1-ba48-1dc08acf674a {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:28:47 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9287be-194b-4d72-a832-3fc22bce8d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234d2a4e-c987-46b7-b6e8-168ed1407d45', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:47 devstack sudo[103896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a 1073741824
Aug 29 13:28:47 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee7f93d-3be8-4dc6-946a-010672155c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:47 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume volume-234d2a4e-c987-46b7-b6e8-168ed1407d45 (234d2a4e-c987-46b7-b6e8-168ed1407d45): created successfully
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee7f93d-3be8-4dc6-946a-010672155c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (f21f7f6e-0c8c-4378-ba53-6564b438eced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:47 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-efe51c56-45b8-4ea3-b258-aab41e26435c tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created volume successfully.
Aug 29 13:28:48 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a 1073741824" returned: 0 in 0.405s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:48 devstack sudo[103902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a
Aug 29 13:28:48 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:48 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a" returned: 0 in 0.238s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-94574599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106e2590-e7d4-4e51-9d47-bc3e020a727d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2955d48fb2043458864826a12196554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:28:47Z,use_quota=True,user_id='87d0852de4a84d488f7359a8e9eaa373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Creating volume 106e2590-e7d4-4e51-9d47-bc3e020a727d {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:28:48 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:48 devstack sudo[103905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d 1073741824
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb30654d-0ab0-47f7-a575-9edceb6128b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:48 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3c7980-04b5-4aa1-bed9-d243e5fd7b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:48 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a (49e0cf56-b3ea-4fc1-ba48-1dc08acf674a): created successfully
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3c7980-04b5-4aa1-bed9-d243e5fd7b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (1b989433-0d27-48a3-a72f-6c1553912ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:48 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e743d7ae-dc99-4802-9093-6a53ea45b868 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created volume successfully.
Aug 29 13:28:48 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d 1073741824" returned: 0 in 0.394s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:48 devstack sudo[103910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d
Aug 29 13:28:48 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:49 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d" returned: 0 in 0.245s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:28:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0d7ff1-4732-49f5-afd2-2dd29ca714e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106e2590-e7d4-4e51-9d47-bc3e020a727d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fd5ca3-61a1-40a7-9272-854b890c3c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:49 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Volume volume-106e2590-e7d4-4e51-9d47-bc3e020a727d (106e2590-e7d4-4e51-9d47-bc3e020a727d): created successfully
Aug 29 13:28:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fd5ca3-61a1-40a7-9272-854b890c3c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Flow 'volume_create_manager' (9b3384f6-45d4-4c53-b104-3fde5629aaa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-eddc9077-6086-43e5-a8db-ba2227da2901 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created volume successfully.
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-106e2590-e7d4-4e51-9d47-bc3e020a727d-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-106e2590-e7d4-4e51-9d47-bc3e020a727d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-quobyte-106e2590-e7d4-4e51-9d47-bc3e020a727d" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-106e2590-e7d4-4e51-9d47-bc3e020a727d" acquired by "delete_volume" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a156cee-0c92-4465-8949-9dd401e4e58e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:50 devstack sudo[103913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d
Aug 29 13:28:50 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:50 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d" returned: 0 in 0.347s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:50 devstack sudo[103918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d
Aug 29 13:28:50 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:50 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-106e2590-e7d4-4e51-9d47-bc3e020a727d" returned: 0 in 0.238s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-106e2590-e7d4-4e51-9d47-bc3e020a727d" released by "delete_volume" :: held 0.620s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created reservations ['dc999038-f5d5-4e76-b84f-0f6a6aa98bb5', 'e1835f40-9769-43fd-a759-691baa66c9ea', '350d33d2-4723-4ab5-a558-6d88ff4d97eb', 'ac5cbe6e-079e-4a29-ac02-e586fa6f4b6d'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:51 devstack sudo[103921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:28:51 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:51 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.241s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:28:51 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Deleted volume successfully.
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8e4cd6ed-f864-49a6-924a-10f5ffb35035 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-106e2590-e7d4-4e51-9d47-bc3e020a727d-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-quobyte-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4bf260-402a-4f23-89e8-7a44678255fc]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:51 devstack sudo[103924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a
Aug 29 13:28:51 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:51 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a" returned: 0 in 0.345s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:51 devstack sudo[103929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a
Aug 29 13:28:51 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:52 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a" returned: 0 in 0.247s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a" released by "delete_volume" :: held 0.628s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created reservations ['8461e8bc-2c2f-430c-ab97-d59c14c8100b', 'da37bb38-040f-4f9a-8e26-a741d2e5ae98', '6a459a5b-cc11-46f0-84be-bd9548decd2c', '1b262114-1210-4289-a3bb-e5bde2adae9c'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:52 devstack sudo[103932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:28:52 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:52 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.235s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:28:52 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Deleted volume successfully.
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ddf12f00-0bac-4bba-8ac0-5366f99506eb tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-49e0cf56-b3ea-4fc1-ba48-1dc08acf674a-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-234d2a4e-c987-46b7-b6e8-168ed1407d45-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-234d2a4e-c987-46b7-b6e8-168ed1407d45-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-quobyte-234d2a4e-c987-46b7-b6e8-168ed1407d45" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-234d2a4e-c987-46b7-b6e8-168ed1407d45" acquired by "delete_volume" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[04094975-04a5-4b1f-b301-a17fbfbae1c6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:52 devstack sudo[103935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45
Aug 29 13:28:52 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:53 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45" returned: 0 in 0.344s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:53 devstack sudo[103941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45
Aug 29 13:28:53 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:53 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-234d2a4e-c987-46b7-b6e8-168ed1407d45" returned: 0 in 0.236s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-234d2a4e-c987-46b7-b6e8-168ed1407d45" released by "delete_volume" :: held 0.619s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created reservations ['f4b798c2-0217-48f3-b584-c84f2d84b05a', 'e693583c-e0de-4bed-b8fa-2c46fa19ea00', '94658732-806b-4200-8f8b-7914350f2249', '3e3a7b5d-8cb5-4525-8f4f-6d205f860523'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:53 devstack sudo[103945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:28:53 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:53 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.247s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:28:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Deleted volume successfully.
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d113a87-bcdd-4041-923e-53e02675b708 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-234d2a4e-c987-46b7-b6e8-168ed1407d45-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-quobyte-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a86b1f-2b94-4646-b166-aa0edcb7b8fa]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:53 devstack sudo[103948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9
Aug 29 13:28:53 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:54 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9" returned: 0 in 0.361s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:54 devstack sudo[103954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9
Aug 29 13:28:54 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:54 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9" returned: 0 in 0.243s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9" released by "delete_volume" :: held 0.640s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created reservations ['88e0703a-4a4a-4bfb-993f-cdc48df6da1e', '3df9e555-54e7-45a8-a2f6-7fa655d6af2f', '35ebc6cf-b2b2-45c2-925f-4b0b7bf75a45', '1b7dbf8e-5207-47eb-a383-a57cb5279d08'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:54 devstack sudo[103957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:28:54 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:54 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:28:54 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:54 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:28:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Deleted volume successfully.
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-87db692a-72aa-47df-9226-e850cd60a7a7 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-a9e43dd3-0b72-4cc4-b6d6-f8496683ebf9-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:54 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-a59debaa-90c5-4833-80d9-fe71d2d7a92f-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.261s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-a59debaa-90c5-4833-80d9-fe71d2d7a92f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-quobyte-a59debaa-90c5-4833-80d9-fe71d2d7a92f" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-a59debaa-90c5-4833-80d9-fe71d2d7a92f" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[323bb821-5d42-49f5-83b1-6efe186614de]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:55 devstack sudo[103963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f
Aug 29 13:28:55 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:55 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f" returned: 0 in 0.345s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:55 devstack sudo[103968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f
Aug 29 13:28:55 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:55 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a59debaa-90c5-4833-80d9-fe71d2d7a92f" returned: 0 in 0.253s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-a59debaa-90c5-4833-80d9-fe71d2d7a92f" released by "delete_volume" :: held 0.638s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created reservations ['c1b4f72e-8da8-498a-bedf-60417a716c97', '1cb793ce-f4f5-4c56-a9ce-a2f6167091c8', 'd390f038-2aa6-4ab1-83b7-d26412505651', 'da06b324-8e7a-4b94-b943-76165a29696f'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:55 devstack sudo[103971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:28:55 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:55 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:28:55 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Deleted volume successfully.
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0c90cb65-8ffc-4af0-a188-9ddc3cfb66aa tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-a59debaa-90c5-4833-80d9-fe71d2d7a92f-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-0104858f-8119-4f30-bc71-ec4d4c2f1a63-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-0104858f-8119-4f30-bc71-ec4d4c2f1a63-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "cinder-quobyte-0104858f-8119-4f30-bc71-ec4d4c2f1a63" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-0104858f-8119-4f30-bc71-ec4d4c2f1a63" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaa4f18-1d0d-4446-827d-e42660b7582b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:56 devstack sudo[103974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63
Aug 29 13:28:56 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:56 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63" returned: 0 in 0.345s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:56 devstack sudo[103979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63
Aug 29 13:28:56 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:56 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0104858f-8119-4f30-bc71-ec4d4c2f1a63" returned: 0 in 0.237s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-quobyte-0104858f-8119-4f30-bc71-ec4d4c2f1a63" released by "delete_volume" :: held 0.619s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Created reservations ['d834a156-1bf6-4692-b67c-5b6df8cef9be', 'ad2c7a83-c287-47f6-a640-e11f71dea521', 'dfdf6ff1-0035-4961-b63e-d39d0addf29a', 'b41bb82e-9842-47b7-a51f-2955fcf69d64'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:56 devstack sudo[103982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:28:56 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:28:57 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root
Aug 29 13:28:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:28:57 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:28:57 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Deleted volume successfully.
Aug 29 13:28:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5752f978-63c1-4a02-b4be-1b5840a66257 tempest-CreateVolumesFromSourceVolumeTest-173994491 None] Lock "cinder-0104858f-8119-4f30-bc71-ec4d4c2f1a63-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Flow 'volume_create_manager' (1f0f2bc1-ec0c-4abf-8780-45d47c4a4455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b820a17-8a7e-4b51-8858-53a8351157f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b820a17-8a7e-4b51-8858-53a8351157f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e996a9f6-e10e-4cd0-868e-4f52539bfd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d65da4e8bf747a487c9ba8251bc779a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:00Z,use_quota=True,user_id='2286b9097ecd4ea6840f796d90d65c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e8ce8d-ab2c-46e3-92a5-b8e9e59b7c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e8ce8d-ab2c-46e3-92a5-b8e9e59b7c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4fc9e1-a64b-437b-b3b4-63ae021ae968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4fc9e1-a64b-437b-b3b4-63ae021ae968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e996a9f6-e10e-4cd0-868e-4f52539bfd68', 'volume_name': 'volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9667458-a7a6-4dd4-b1bd-3004d2aefe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9667458-a7a6-4dd4-b1bd-3004d2aefe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327b7f85-0dd2-4c55-933e-0b6f9da79403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:28:59 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Volume e996a9f6-e10e-4cd0-868e-4f52539bfd68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68', 'volume_size': 1}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e996a9f6-e10e-4cd0-868e-4f52539bfd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d65da4e8bf747a487c9ba8251bc779a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:00Z,use_quota=True,user_id='2286b9097ecd4ea6840f796d90d65c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Creating volume e996a9f6-e10e-4cd0-868e-4f52539bfd68 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:28:59 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:28:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:28:59 devstack sudo[103985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68 1073741824
Aug 29 13:28:59 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:00 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68 1073741824" returned: 0 in 0.416s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:00 devstack sudo[103990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68
Aug 29 13:29:00 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:00 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327b7f85-0dd2-4c55-933e-0b6f9da79403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c36903e-9180-49da-afb3-77cc5a4a0c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:00 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Volume volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68 (e996a9f6-e10e-4cd0-868e-4f52539bfd68): created successfully
Aug 29 13:29:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c36903e-9180-49da-afb3-77cc5a4a0c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Flow 'volume_create_manager' (1f0f2bc1-ec0c-4abf-8780-45d47c4a4455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a585f161-2c0b-431b-8582-60c402a40594 tempest-CinderUnicodeTest-1860643615 None] Created volume successfully.
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Flow 'volume_create_manager' (c043ec9d-1fed-481c-9f74-83ad5ab145ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772e1d72-675e-42f2-8965-299085fe5808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772e1d72-675e-42f2-8965-299085fe5808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-502684837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c2618-cf2d-4797-8d6e-3ba4651c36eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d65da4e8bf747a487c9ba8251bc779a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:01Z,use_quota=True,user_id='2286b9097ecd4ea6840f796d90d65c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b8e46-680c-463e-80a2-fe051fdf644c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b8e46-680c-463e-80a2-fe051fdf644c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb85566f-dca5-46b7-8522-72ef83f5a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb85566f-dca5-46b7-8522-72ef83f5a996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73c2618-cf2d-4797-8d6e-3ba4651c36eb', 'volume_name': 'volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c70ac82-fb9b-474c-b425-ac39489e5755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c70ac82-fb9b-474c-b425-ac39489e5755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a5c9b9-f7e1-47fb-96c4-ede4d9c5db5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:01 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Volume c73c2618-cf2d-4797-8d6e-3ba4651c36eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb', 'volume_size': 1}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-502684837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c2618-cf2d-4797-8d6e-3ba4651c36eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d65da4e8bf747a487c9ba8251bc779a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:01Z,use_quota=True,user_id='2286b9097ecd4ea6840f796d90d65c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Creating volume c73c2618-cf2d-4797-8d6e-3ba4651c36eb {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:01 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:01 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb 1073741824
Aug 29 13:29:01 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:01 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb 1073741824" returned: 0 in 0.393s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:01 devstack sudo[104000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb
Aug 29 13:29:01 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:02 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" returned: 0 in 0.258s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a5c9b9-f7e1-47fb-96c4-ede4d9c5db5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe27e2d8-c373-46dd-ae16-9186e1c704d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:02 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Volume volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb (c73c2618-cf2d-4797-8d6e-3ba4651c36eb): created successfully
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe27e2d8-c373-46dd-ae16-9186e1c704d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Flow 'volume_create_manager' (c043ec9d-1fed-481c-9f74-83ad5ab145ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-80a75d5c-b192-46ed-8dcd-00605239bf1d tempest-CinderUnicodeTest-1860643615 None] Created volume successfully.
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Creating offline snapshot 2217301c-7398-48da-8956-6addb8bacc16 of volume c73c2618-cf2d-4797-8d6e-3ba4651c36eb {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5492f2d-f4a3-4f7b-a789-dd2281942f71]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:02 devstack sudo[104003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb
Aug 29 13:29:02 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:02 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" returned: 0 in 0.352s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:02 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 1G
Aug 29 13:29:02 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:03 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 1G" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:03 devstack sudo[104014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16
Aug 29 13:29:03 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:03 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16" returned: 0 in 0.287s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:03 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 is being set with open permissions: ugo+rw
Aug 29 13:29:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:03 devstack sudo[104020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16
Aug 29 13:29:03 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:03 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16" returned: 0 in 0.252s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:03 devstack sudo[104023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.info
Aug 29 13:29:03 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:04 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.info" returned: 0 in 0.268s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:04 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.info is being set with open permissions: ugo+rw
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:04 devstack sudo[104026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.info
Aug 29 13:29:04 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:04 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.info" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:04 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-06fae258-399e-4318-9a73-a228084894ee tempest-CinderUnicodeTest-1860643615 None] Create snapshot completed successfully
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "cinder-2217301c-7398-48da-8956-6addb8bacc16-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-2217301c-7398-48da-8956-6addb8bacc16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "cinder-quobyte-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-quobyte-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" acquired by "delete_snapshot" :: waited 0.012s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "cinder-quobyte-2217301c-7398-48da-8956-6addb8bacc16" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-quobyte-2217301c-7398-48da-8956-6addb8bacc16" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Deleting offline snapshot 2217301c-7398-48da-8956-6addb8bacc16 of volume c73c2618-cf2d-4797-8d6e-3ba4651c36eb {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] snapshot_file for this snap is: volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0868e6-f64d-444f-9ed1-7210838d86da]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:04 devstack sudo[104029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16
Aug 29 13:29:04 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:05 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16" returned: 0 in 0.355s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:29:05 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[af749bbd-c309-4d42-ac72-6913b264e782]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:05 devstack sudo[104034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb
Aug 29 13:29:05 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:05 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" returned: 0 in 0.349s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:05 devstack sudo[104039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16
Aug 29 13:29:05 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:05 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16" returned: 0 in 0.322s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:05 devstack sudo[104045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16
Aug 29 13:29:05 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:06 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb.2217301c-7398-48da-8956-6addb8bacc16" returned: 0 in 0.241s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-quobyte-2217301c-7398-48da-8956-6addb8bacc16" released by "_delete_snapshot" :: held 1.358s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-quobyte-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" released by "delete_snapshot" :: held 1.377s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Created reservations ['79893bf3-03e6-4705-8e08-badf21ee8f9d', '171d7fc4-10b4-4f86-bb69-3e8574b350aa', '186861f1-6757-4a83-8507-b8d4ef601b46', '5f6369b9-afa6-42cb-b13b-05c35044651a'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Delete snapshot completed successfully.
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1ba360c4-0f3c-45cb-bdfc-0b6b9658c4a4 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-2217301c-7398-48da-8956-6addb8bacc16-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "cinder-c73c2618-cf2d-4797-8d6e-3ba4651c36eb-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-c73c2618-cf2d-4797-8d6e-3ba4651c36eb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "cinder-quobyte-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-quobyte-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" acquired by "delete_volume" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7f5bd0-45c6-40af-abc5-07219cbecae7]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:07 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb
Aug 29 13:29:07 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:07 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" returned: 0 in 0.356s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:07 devstack sudo[104053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb
Aug 29 13:29:07 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:07 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" returned: 0 in 0.238s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-quobyte-c73c2618-cf2d-4797-8d6e-3ba4651c36eb" released by "delete_volume" :: held 0.646s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Created reservations ['e9fec1f9-6ac8-4fcf-953f-d243b600e787', '20e492bf-db18-4d99-a30a-4fa5e01b8e3a', 'e4257fb4-0b91-4868-b072-312d3cd71b17', 'c791e847-56b9-406b-aa8d-c4d7a67db1e9'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:07 devstack sudo[104056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:07 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:07 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.233s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Deleted volume successfully.
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-fd4bf62e-5e4b-4fd8-a2dc-a8f4a2e3bef3 tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-c73c2618-cf2d-4797-8d6e-3ba4651c36eb-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "cinder-e996a9f6-e10e-4cd0-868e-4f52539bfd68-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-e996a9f6-e10e-4cd0-868e-4f52539bfd68-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "cinder-quobyte-e996a9f6-e10e-4cd0-868e-4f52539bfd68" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-quobyte-e996a9f6-e10e-4cd0-868e-4f52539bfd68" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a2b5d7-92a3-49bd-814d-a63ff4bf1ef7]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:08 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68
Aug 29 13:29:08 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:08 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68" returned: 0 in 0.352s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:08 devstack sudo[104064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68
Aug 29 13:29:08 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:08 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e996a9f6-e10e-4cd0-868e-4f52539bfd68" returned: 0 in 0.234s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-quobyte-e996a9f6-e10e-4cd0-868e-4f52539bfd68" released by "delete_volume" :: held 0.620s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Created reservations ['46b9c7e6-90df-4ffa-bc72-f5284205a7dd', '09169e69-d02d-49a3-b383-f9dc4f9825da', '3edb4210-15be-4b57-a16c-3c415eb3f151', 'fd3b7636-42c6-4a87-8f48-58c09b46f2a9'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:08 devstack sudo[104067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:08 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:09 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.231s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:09 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Deleted volume successfully.
Aug 29 13:29:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-384d27ad-05b7-4bc2-a414-517a63c1f37c tempest-CinderUnicodeTest-1860643615 None] Lock "cinder-e996a9f6-e10e-4cd0-868e-4f52539bfd68-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:18 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=84,cinder:UPDATE=125,cinder:INSERT=27,cinder:DELETE=9 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:29:19 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=84,cinder:INSERT=37,cinder:UPDATE=108,cinder:DELETE=11 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Flow 'volume_create_manager' (0763fcf1-abeb-416c-b36e-f8d8be0c2c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (271f166c-6457-4c68-9096-104d2e3e6d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (271f166c-6457-4c68-9096-104d2e3e6d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1695569603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7906661-6030-43ba-9a5f-7e683125cad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551b9bf1684c41fca2a6681dd3656927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:20Z,use_quota=True,user_id='c23bb392ec8441df91beffe045838073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a994d4-1316-4e1a-8172-248996629947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a994d4-1316-4e1a-8172-248996629947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231ea6a8-7fa6-433f-baf0-24d3033dbedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231ea6a8-7fa6-433f-baf0-24d3033dbedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7906661-6030-43ba-9a5f-7e683125cad4', 'volume_name': 'volume-a7906661-6030-43ba-9a5f-7e683125cad4', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b52e929-733b-45f3-9665-e95fb5d4ebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b52e929-733b-45f3-9665-e95fb5d4ebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac36823c-d273-415a-a7f2-dbe64acb2c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:20 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Volume a7906661-6030-43ba-9a5f-7e683125cad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7906661-6030-43ba-9a5f-7e683125cad4', 'volume_size': 1}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1695569603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7906661-6030-43ba-9a5f-7e683125cad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551b9bf1684c41fca2a6681dd3656927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:20Z,use_quota=True,user_id='c23bb392ec8441df91beffe045838073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Creating volume a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:20 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:20 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 1073741824
Aug 29 13:29:20 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:21 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (298465d4-b6f1-4e89-9554-c72e333c071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09505bdf-2de5-41c3-aaa4-5e1a0449176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 1073741824" returned: 0 in 0.647s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09505bdf-2de5-41c3-aaa4-5e1a0449176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126966158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62567071-c3b3-4366-853a-fdb90bf52db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:21Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63213f6c-3424-493a-b27e-0700f661448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63213f6c-3424-493a-b27e-0700f661448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1981c79-28cb-47db-9aeb-f5b36f841755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1981c79-28cb-47db-9aeb-f5b36f841755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62567071-c3b3-4366-853a-fdb90bf52db7', 'volume_name': 'volume-62567071-c3b3-4366-853a-fdb90bf52db7', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524765fe-d48b-478c-ac20-e69c72d56e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524765fe-d48b-478c-ac20-e69c72d56e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8cde22-28f2-4cca-bd16-d992c36dc7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Volume 62567071-c3b3-4366-853a-fdb90bf52db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62567071-c3b3-4366-853a-fdb90bf52db7', 'volume_size': 1}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:21 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4
Aug 29 13:29:21 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:21 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (d3923e1f-9203-46a7-b582-e00d0a63dd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf54da77-7b4b-4baa-9f55-4472fdf4723a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4" returned: 0 in 0.379s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126966158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62567071-c3b3-4366-853a-fdb90bf52db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:21Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Creating volume 62567071-c3b3-4366-853a-fdb90bf52db7 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:21 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf54da77-7b4b-4baa-9f55-4472fdf4723a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968605292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84fb80a-9fde-4cf3-bc08-effa6faead91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:22Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9df73d-4458-4cdc-b0b1-08866ec69b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9df73d-4458-4cdc-b0b1-08866ec69b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8231c8ff-445e-4bbf-a040-bc490356d134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8231c8ff-445e-4bbf-a040-bc490356d134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84fb80a-9fde-4cf3-bc08-effa6faead91', 'volume_name': 'volume-b84fb80a-9fde-4cf3-bc08-effa6faead91', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e8b19-4102-4a97-8d36-9e3d80661b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7 1073741824
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e8b19-4102-4a97-8d36-9e3d80661b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08f2428-ead9-4702-9ff9-e4c1d4217132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Volume b84fb80a-9fde-4cf3-bc08-effa6faead91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84fb80a-9fde-4cf3-bc08-effa6faead91', 'volume_size': 1}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac36823c-d273-415a-a7f2-dbe64acb2c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7906661-6030-43ba-9a5f-7e683125cad4', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaee871-7790-47e8-8762-0bb7ad2f742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:21 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Volume volume-a7906661-6030-43ba-9a5f-7e683125cad4 (a7906661-6030-43ba-9a5f-7e683125cad4): created successfully
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaee871-7790-47e8-8762-0bb7ad2f742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:21 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Flow 'volume_create_manager' (0763fcf1-abeb-416c-b36e-f8d8be0c2c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d662c0cd-54fd-4888-9978-e2a4be3bca94 tempest-VolumeDependencyTests-341561756 None] Created volume successfully.
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (cfde00ba-815c-43ac-9773-2ca3e3aa2eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c826e31-9716-46c3-943b-430df292a095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c826e31-9716-46c3-943b-430df292a095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1357964799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470370ba-474b-4607-8ec5-fc7ad2b474d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:22Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95dbf027-980d-4dd2-9609-f64776be00e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95dbf027-980d-4dd2-9609-f64776be00e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0e6b49-ccc5-4a56-8fc2-91865c96fee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0e6b49-ccc5-4a56-8fc2-91865c96fee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470370ba-474b-4607-8ec5-fc7ad2b474d4', 'volume_name': 'volume-470370ba-474b-4607-8ec5-fc7ad2b474d4', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22248a0b-69e8-444e-96e5-caf0ccf55e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22248a0b-69e8-444e-96e5-caf0ccf55e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c904fb67-c93e-45d8-8cfe-acf15243f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Volume 470370ba-474b-4607-8ec5-fc7ad2b474d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470370ba-474b-4607-8ec5-fc7ad2b474d4', 'volume_size': 1}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:22 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7 1073741824" returned: 0 in 0.712s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:22 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7
Aug 29 13:29:22 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (6fb56e17-1000-4358-bc58-d57367b8f056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82304e96-3134-46da-a3b7-5161a9dd52c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82304e96-3134-46da-a3b7-5161a9dd52c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632526498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa2447e-0274-4470-916d-b7f6931e41e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:23Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50df674c-4e94-4abd-9883-c3fc16fa6165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50df674c-4e94-4abd-9883-c3fc16fa6165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c658af3a-accd-4ceb-a28c-90447779ce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c658af3a-accd-4ceb-a28c-90447779ce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa2447e-0274-4470-916d-b7f6931e41e4', 'volume_name': 'volume-2aa2447e-0274-4470-916d-b7f6931e41e4', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca5bd00-b188-4f6d-a9c3-709af6a49c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca5bd00-b188-4f6d-a9c3-709af6a49c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f0ad17-fc6e-403c-bb51-02a63ae35150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:22 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Volume 2aa2447e-0274-4470-916d-b7f6931e41e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa2447e-0274-4470-916d-b7f6931e41e4', 'volume_size': 1}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:22 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7" returned: 0 in 0.441s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968605292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84fb80a-9fde-4cf3-bc08-effa6faead91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:22Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Creating volume b84fb80a-9fde-4cf3-bc08-effa6faead91 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:23 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8cde22-28f2-4cca-bd16-d992c36dc7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62567071-c3b3-4366-853a-fdb90bf52db7', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7b31e9-b4c6-4f79-aaa9-458505886cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:23 devstack sudo[104127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91 1073741824
Aug 29 13:29:23 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:23 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Volume volume-62567071-c3b3-4366-853a-fdb90bf52db7 (62567071-c3b3-4366-853a-fdb90bf52db7): created successfully
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7b31e9-b4c6-4f79-aaa9-458505886cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (298465d4-b6f1-4e89-9554-c72e333c071e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:23 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9e639969-108a-4ce0-af16-f8eb219063cf tempest-CreateVolumesFromImageTest-1325367696 None] Created volume successfully.
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (91567d0e-163d-484f-bb23-f32c25edfcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2acc8e-541c-4996-81da-c404352302a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2acc8e-541c-4996-81da-c404352302a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-726438135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65221023-0a84-4107-ae08-ca6e650d5227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:23Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3637d244-9d39-44ea-aa36-aca425628766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3637d244-9d39-44ea-aa36-aca425628766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b01885-9b24-49d9-9573-f30a6590df7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b01885-9b24-49d9-9573-f30a6590df7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65221023-0a84-4107-ae08-ca6e650d5227', 'volume_name': 'volume-65221023-0a84-4107-ae08-ca6e650d5227', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c100e06d-b8d2-47b0-b14e-31f8592a8a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c100e06d-b8d2-47b0-b14e-31f8592a8a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4075d3-4269-4296-b46f-80c6596e73ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:23 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Volume 65221023-0a84-4107-ae08-ca6e650d5227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65221023-0a84-4107-ae08-ca6e650d5227', 'volume_size': 1}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:23 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91 1073741824" returned: 0 in 0.586s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:23 devstack sudo[104134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91
Aug 29 13:29:23 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:23 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91" returned: 0 in 0.314s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.570s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1357964799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470370ba-474b-4607-8ec5-fc7ad2b474d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:22Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Creating volume 470370ba-474b-4607-8ec5-fc7ad2b474d4 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:23 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:24 devstack sudo[104137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4 1073741824
Aug 29 13:29:24 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08f2428-ead9-4702-9ff9-e4c1d4217132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84fb80a-9fde-4cf3-bc08-effa6faead91', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1efe962-f5ab-4364-9390-6e469dd79c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Flow 'volume_create_manager' (44428f3f-8560-4aff-90fa-d63512a30c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8f0a0a-a45f-4dcb-89a2-cbfd44d31ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:24 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Volume volume-b84fb80a-9fde-4cf3-bc08-effa6faead91 (b84fb80a-9fde-4cf3-bc08-effa6faead91): created successfully
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1efe962-f5ab-4364-9390-6e469dd79c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (d3923e1f-9203-46a7-b582-e00d0a63dd0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8f0a0a-a45f-4dcb-89a2-cbfd44d31ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a060ead-2dc6-48b5-b8eb-40a98bc94eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4937c9f3abb4027b56acab8ca24adac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:24Z,use_quota=True,user_id='1f22eec063de4d2e861c385fe11e85fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c44f4a-1247-4c3a-af2b-0a6cea0c1240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c44f4a-1247-4c3a-af2b-0a6cea0c1240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e484e51-85ed-42e0-8c86-c8a676d9ae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:29:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-592499b5-3a71-4f1a-b458-8dc6bf13caac tempest-CreateVolumesFromImageTest-1325367696 None] Created volume successfully.
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e484e51-85ed-42e0-8c86-c8a676d9ae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a060ead-2dc6-48b5-b8eb-40a98bc94eac', 'volume_name': 'volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac', 'volume_size': 1, 'image_id': 'ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'acb3d616743eb06cd8662067f1e89250', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f4937c9f3abb4027b56acab8ca24adac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '799ff2a6fa5a2a68b97454f63e75191b32b2d7ff58c67d8dabff3dca721628c14b6a9a51c2b7b75bb56b4dfa69c21519caabe90fa4bfc98be381152bcce91223', 'id': 'ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'created_at': datetime.datetime(2026, 8, 29, 11, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 29, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef265e46-f218-40af-8f12-4e4c8ae3cc3a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6165afe60>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7c56ec-c3c6-49da-a438-8b4647a0f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7c56ec-c3c6-49da-a438-8b4647a0f882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b17893-0034-4f56-812b-0440ef689017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:24 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Volume 0a060ead-2dc6-48b5-b8eb-40a98bc94eac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac', 'volume_size': 1, 'image_id': 'ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'acb3d616743eb06cd8662067f1e89250', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f4937c9f3abb4027b56acab8ca24adac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '799ff2a6fa5a2a68b97454f63e75191b32b2d7ff58c67d8dabff3dca721628c14b6a9a51c2b7b75bb56b4dfa69c21519caabe90fa4bfc98be381152bcce91223', 'id': 'ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'created_at': datetime.datetime(2026, 8, 29, 11, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 29, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef265e46-f218-40af-8f12-4e4c8ae3cc3a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6165afe60>}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Trying to clone 0a060ead-2dc6-48b5-b8eb-40a98bc94eac from image ef265e46-f218-40af-8f12-4e4c8ae3cc3a at location (None, [{'url': 'file:///opt/stack/data/glance/images/ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:29:24 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4 1073741824" returned: 0 in 0.576s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:29:24 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Image download 0.00 MB at 0.00 MB/s
Aug 29 13:29:24 devstack sudo[104143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4
Aug 29 13:29:24 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4ad400-1644-4b64-b396-f987b316ae1b]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:24 devstack sudo[104145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD
Aug 29 13:29:24 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:24 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4" returned: 0 in 0.272s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.912s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632526498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa2447e-0274-4470-916d-b7f6931e41e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:23Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Creating volume 2aa2447e-0274-4470-916d-b7f6931e41e4 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:24 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c904fb67-c93e-45d8-8cfe-acf15243f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470370ba-474b-4607-8ec5-fc7ad2b474d4', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0db2875-130a-4737-8d10-4c37cbc0fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:24 devstack sudo[104148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4 1073741824
Aug 29 13:29:24 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:24 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Volume volume-470370ba-474b-4607-8ec5-fc7ad2b474d4 (470370ba-474b-4607-8ec5-fc7ad2b474d4): created successfully
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0db2875-130a-4737-8d10-4c37cbc0fab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:24 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (cfde00ba-815c-43ac-9773-2ca3e3aa2eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fd6c1d54-4f49-4fbb-94c8-5ef2431e1e64 tempest-CreateVolumesFromImageTest-1325367696 None] Created volume successfully.
Aug 29 13:29:25 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:25 devstack sudo[104152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD
Aug 29 13:29:25 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:25 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Temporary image ef265e46-f218-40af-8f12-4e4c8ae3cc3a is fetched for user 1f22eec063de4d2e861c385fe11e85fa. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:29:25 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4 1073741824" returned: 0 in 0.533s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:25 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4
Aug 29 13:29:25 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b0ff60-687c-4cb2-a5d7-76238af5bfd5]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:25 devstack sudo[104165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD
Aug 29 13:29:25 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Flow 'volume_create_manager' (1cedb092-8871-4276-a760-247e2b32c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3da2cc0-75c7-415d-b08e-f3885f642b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3da2cc0-75c7-415d-b08e-f3885f642b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfba230-9657-4c14-84d7-0547ba03a97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0da695a8684f468830e00ea6ba9f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:26Z,use_quota=True,user_id='30c8bd701f11497eb0344262bdb3fddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9cc19f8-f099-48a1-8e12-9988b4021dab),volume_type_id=d9cc19f8-f099-48a1-8e12-9988b4021dab)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e98a28a-dd1b-4975-92b2-e5d31a60129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e98a28a-dd1b-4975-92b2-e5d31a60129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e772faa-f705-4693-97b8-0900098001eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.image.glance [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Creating Keystone auth plugin from conf {{(pid=85771) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 29 13:29:25 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4" returned: 0 in 0.293s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.763s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Creating offline snapshot 97c95b99-3558-44b0-9441-28df80d8ebbc of volume a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f0ad17-fc6e-403c-bb51-02a63ae35150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa2447e-0274-4470-916d-b7f6931e41e4', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78037d07-a6fa-4827-8f31-25842596d8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aecb765-df86-41fa-a341-a79143ddcaa2]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:25 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Volume volume-2aa2447e-0274-4470-916d-b7f6931e41e4 (2aa2447e-0274-4470-916d-b7f6931e41e4): created successfully
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78037d07-a6fa-4827-8f31-25842596d8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (6fb56e17-1000-4358-bc58-d57367b8f056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-14798613-47e8-4be4-a477-24050dd49529 tempest-CreateVolumesFromImageTest-1325367696 None] Created volume successfully.
Aug 29 13:29:25 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:25 devstack sudo[104168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4
Aug 29 13:29:25 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e772faa-f705-4693-97b8-0900098001eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7cfba230-9657-4c14-84d7-0547ba03a97a', 'volume_name': 'volume-7cfba230-9657-4c14-84d7-0547ba03a97a', 'volume_size': 1, 'image_id': '14487164-1a3f-46af-9c0f-d6d01855b7df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14487164-1a3f-46af-9c0f-d6d01855b7df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71eb7be795e92730541f42ebb58ad37b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef0da695a8684f468830e00ea6ba9f3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a3544e20813bf648e3efc602e6a1b46b164fe82553be414588875f8ea3c694c6b2e0cd0633ebb0ddd175a7ea3ad761466bcc6b50a0625f96e9e8131f13f5501', 'id': '14487164-1a3f-46af-9c0f-d6d01855b7df', 'created_at': datetime.datetime(2026, 8, 29, 11, 29, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 29, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14487164-1a3f-46af-9c0f-d6d01855b7df/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6166288c0>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:25 devstack sudo[104171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD
Aug 29 13:29:25 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c45753-deae-4249-b9e8-4e19e34e8dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c45753-deae-4249-b9e8-4e19e34e8dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b8da53-ca85-44bb-b704-095d8ec4539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:26 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Volume 7cfba230-9657-4c14-84d7-0547ba03a97a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7cfba230-9657-4c14-84d7-0547ba03a97a', 'volume_size': 1, 'image_id': '14487164-1a3f-46af-9c0f-d6d01855b7df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14487164-1a3f-46af-9c0f-d6d01855b7df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71eb7be795e92730541f42ebb58ad37b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef0da695a8684f468830e00ea6ba9f3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a3544e20813bf648e3efc602e6a1b46b164fe82553be414588875f8ea3c694c6b2e0cd0633ebb0ddd175a7ea3ad761466bcc6b50a0625f96e9e8131f13f5501', 'id': '14487164-1a3f-46af-9c0f-d6d01855b7df', 'created_at': datetime.datetime(2026, 8, 29, 11, 29, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 29, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14487164-1a3f-46af-9c0f-d6d01855b7df/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6166288c0>}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Trying to clone 7cfba230-9657-4c14-84d7-0547ba03a97a from image 14487164-1a3f-46af-9c0f-d6d01855b7df at location (None, [{'url': 'file:///opt/stack/data/glance/images/14487164-1a3f-46af-9c0f-d6d01855b7df', 'metadata': {}}]). {{(pid=85771) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 29 13:29:26 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Image download 0.00 MB at 0.00 MB/s
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[26033504-1d21-4b4c-adc7-b8fc45ec3cf8]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:26 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4" returned: 0 in 0.409s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:26 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:26 devstack sudo[104181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc 1G
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:26 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:26 devstack sudo[104178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD
Aug 29 13:29:26 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:26 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:26 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc 1G" returned: 0 in 0.454s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7906661-6030-43ba-9a5f-7e683125cad4 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:26 devstack sudo[104190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD
Aug 29 13:29:26 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:26 devstack sudo[104191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7906661-6030-43ba-9a5f-7e683125cad4 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc
Aug 29 13:29:26 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:26 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Temporary image 14487164-1a3f-46af-9c0f-d6d01855b7df is fetched for user 30c8bd701f11497eb0344262bdb3fddb. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 29 13:29:26 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7906661-6030-43ba-9a5f-7e683125cad4 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc" returned: 0 in 0.301s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:26 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc is being set with open permissions: ugo+rw
Aug 29 13:29:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:26 devstack sudo[104200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc
Aug 29 13:29:26 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e3f9c6-dfaf-47b1-97b7-1902b1ba18bf]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:27 devstack sudo[104202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD
Aug 29 13:29:27 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:27 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:27 devstack sudo[104205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.info
Aug 29 13:29:27 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:27 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:27 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD
Aug 29 13:29:27 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:27 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.info" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:27 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.info is being set with open permissions: ugo+rw
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:27 devstack sudo[104212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.info
Aug 29 13:29:27 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:27 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:27 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.info" returned: 0 in 0.263s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.348s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-726438135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65221023-0a84-4107-ae08-ca6e650d5227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4839620c85c43aabe52a1adf35bbc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:23Z,use_quota=True,user_id='a50625e2a15d40d487f23b29dcbe2933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Creating volume 65221023-0a84-4107-ae08-ca6e650d5227 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:27 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:27 devstack sudo[104227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227 1073741824
Aug 29 13:29:27 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:27 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-487570a1-68a0-4a71-b3dd-6ab7ae00c942 tempest-VolumeDependencyTests-341561756 None] Create snapshot completed successfully
Aug 29 13:29:28 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227 1073741824" returned: 0 in 0.458s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:28 devstack sudo[104260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227
Aug 29 13:29:28 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:28 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.342s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a060ead-2dc6-48b5-b8eb-40a98bc94eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4937c9f3abb4027b56acab8ca24adac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:24Z,use_quota=True,user_id='1f22eec063de4d2e861c385fe11e85fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Creating volume 0a060ead-2dc6-48b5-b8eb-40a98bc94eac {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:28 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:28 devstack sudo[104263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac 1073741824
Aug 29 13:29:28 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4075d3-4269-4296-b46f-80c6596e73ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65221023-0a84-4107-ae08-ca6e650d5227', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9f12c7-4e60-411e-b725-f23557a564c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:28 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Volume volume-65221023-0a84-4107-ae08-ca6e650d5227 (65221023-0a84-4107-ae08-ca6e650d5227): created successfully
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9f12c7-4e60-411e-b725-f23557a564c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Flow 'volume_create_manager' (91567d0e-163d-484f-bb23-f32c25edfcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:28 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a4d549f1-7669-4643-8e79-342a8601653e tempest-CreateVolumesFromImageTest-1325367696 None] Created volume successfully.
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Flow 'volume_create_manager' (4317a36c-3c4e-4377-9d68-a62fef1ab286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e3fc51-466e-40d4-8ece-a9e00b25a2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e3fc51-466e-40d4-8ece-a9e00b25a2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-887848088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d98dbc6-546a-42b4-93fb-6bad3e1d926c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551b9bf1684c41fca2a6681dd3656927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97c95b99-3558-44b0-9441-28df80d8ebbc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:29Z,use_quota=True,user_id='c23bb392ec8441df91beffe045838073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f68e130-b140-4496-a2d2-af5cac033d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f68e130-b140-4496-a2d2-af5cac033d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f1c62d-8dbe-4b91-943f-770a901fcc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f1c62d-8dbe-4b91-943f-770a901fcc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d98dbc6-546a-42b4-93fb-6bad3e1d926c', 'volume_name': 'volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c', 'volume_size': 1, 'snapshot_id': '97c95b99-3558-44b0-9441-28df80d8ebbc'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c916ef4-781b-4b8b-817f-1c4c5f85c07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c916ef4-781b-4b8b-817f-1c4c5f85c07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef05c1e-7970-416c-a785-190f5d61a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:28 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Volume 0d98dbc6-546a-42b4-93fb-6bad3e1d926c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c', 'volume_size': 1, 'snapshot_id': '97c95b99-3558-44b0-9441-28df80d8ebbc'}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-65221023-0a84-4107-ae08-ca6e650d5227-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-65221023-0a84-4107-ae08-ca6e650d5227-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:28 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-quobyte-65221023-0a84-4107-ae08-ca6e650d5227" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-65221023-0a84-4107-ae08-ca6e650d5227" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dcd6b5-0ab7-43af-84a7-9a29c6b4ffed]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:29 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac 1073741824" returned: 0 in 0.516s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:29 devstack sudo[104269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227
Aug 29 13:29:29 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:29 devstack sudo[104271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac
Aug 29 13:29:29 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:29 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227" returned: 0 in 0.361s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:29 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfba230-9657-4c14-84d7-0547ba03a97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0da695a8684f468830e00ea6ba9f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:26Z,use_quota=True,user_id='30c8bd701f11497eb0344262bdb3fddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9cc19f8-f099-48a1-8e12-9988b4021dab),volume_type_id=d9cc19f8-f099-48a1-8e12-9988b4021dab)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Creating volume 7cfba230-9657-4c14-84d7-0547ba03a97a {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:29 devstack sudo[104277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:29 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:29 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:29 devstack sudo[104279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a 1073741824
Aug 29 13:29:29 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Attempting download of ef265e46-f218-40af-8f12-4e4c8ae3cc3a ((None, [{'url': 'file:///opt/stack/data/glance/images/ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'metadata': {}}])) to volume 0a060ead-2dc6-48b5-b8eb-40a98bc94eac. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116030e-573f-44a0-a781-ec271a8d8d6e]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_l_dspaxq {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:29 devstack sudo[104281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_l_dspaxq
Aug 29 13:29:29 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:29 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-65221023-0a84-4107-ae08-ca6e650d5227" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-65221023-0a84-4107-ae08-ca6e650d5227" released by "delete_volume" :: held 0.670s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Created reservations ['66c3aeb3-1193-4f51-9914-fd9e0badf3e8', 'c52d54d2-8715-414f-90f1-7fe7b904d011', '91daa25e-df3d-40d3-ab9c-5ae25fa1ef43', '1b4cdf43-ce90-452a-9b78-a848a1b0f3c1'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:29 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_l_dspaxq" returned: 0 in 0.355s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_l_dspaxq {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:29 devstack sudo[104290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:29 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:29 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a 1073741824" returned: 0 in 0.505s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:29 devstack sudo[104291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_l_dspaxq
Aug 29 13:29:29 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:29 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a
Aug 29 13:29:29 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:30 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-2aa2447e-0274-4470-916d-b7f6931e41e4-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.298s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:30 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Deleted volume successfully.
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-2aa2447e-0274-4470-916d-b7f6931e41e4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-a5b21ccf-02e6-4c81-845d-cfc72185b86a tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-65221023-0a84-4107-ae08-ca6e650d5227-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-quobyte-2aa2447e-0274-4470-916d-b7f6931e41e4" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:30 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_l_dspaxq" returned: 1 in 0.379s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_l_dspaxq' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[028f8211-13b0-4263-ba39-6a17b34bf527]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-2aa2447e-0274-4470-916d-b7f6931e41e4" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:30 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a" returned: 0 in 0.346s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb1a17d-6a62-48ec-82d2-92cf12d1db22]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.418s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "cinder-quobyte-97c95b99-3558-44b0-9441-28df80d8ebbc-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" by "_create_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-97c95b99-3558-44b0-9441-28df80d8ebbc-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Creating volume 0d98dbc6-546a-42b4-93fb-6bad3e1d926c from snapshot 97c95b99-3558-44b0-9441-28df80d8ebbc {{(pid=85771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "cinder-quobyte-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Attempting download of 14487164-1a3f-46af-9c0f-d6d01855b7df ((None, [{'url': 'file:///opt/stack/data/glance/images/14487164-1a3f-46af-9c0f-d6d01855b7df', 'metadata': {}}])) to volume 7cfba230-9657-4c14-84d7-0547ba03a97a. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] snapshot: 97c95b99-3558-44b0-9441-28df80d8ebbc, volume: 0d98dbc6-546a-42b4-93fb-6bad3e1d926c,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:29:30 devstack sudo[104300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD
Aug 29 13:29:30 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6999dd-cbd0-4e98-bda1-efafa43b5475]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:30 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4
Aug 29 13:29:30 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[22feeacb-1077-48e4-9401-fe9c57e7f0af]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14487164-1a3f-46af-9c0f-d6d01855b7df_aidjytkn {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:30 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc
Aug 29 13:29:30 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:30 devstack sudo[104305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14487164-1a3f-46af-9c0f-d6d01855b7df_aidjytkn
Aug 29 13:29:30 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:30 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:30 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4" returned: 0 in 0.414s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:30 devstack sudo[104314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4
Aug 29 13:29:30 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:30 devstack sudo[104312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD
Aug 29 13:29:30 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:30 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc" returned: 0 in 0.431s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7906661-6030-43ba-9a5f-7e683125cad4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:29:30 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14487164-1a3f-46af-9c0f-d6d01855b7df_aidjytkn" returned: 0 in 0.424s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14487164-1a3f-46af-9c0f-d6d01855b7df_aidjytkn {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[506b1751-c4b9-41b9-a82b-6e769ab7b5f3]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:31 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14487164-1a3f-46af-9c0f-d6d01855b7df_aidjytkn
Aug 29 13:29:31 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:31 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:31 devstack sudo[104324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4
Aug 29 13:29:31 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2aa2447e-0274-4470-916d-b7f6931e41e4" returned: 0 in 0.297s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:31 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] ef265e46-f218-40af-8f12-4e4c8ae3cc3a was raw, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-2aa2447e-0274-4470-916d-b7f6931e41e4" released by "delete_volume" :: held 0.795s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:31 devstack sudo[104331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac
Aug 29 13:29:31 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Created reservations ['d47182f3-ec7c-4991-aada-7a8560caab92', '80e222d0-c10e-422c-aebf-263bbaca79d5', '4e63a225-f1a3-415b-b178-9d671df9b969', '8d7343d5-9027-4b50-b9cd-190f5243a677'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:31 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14487164-1a3f-46af-9c0f-d6d01855b7df_aidjytkn" returned: 1 in 0.381s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14487164-1a3f-46af-9c0f-d6d01855b7df_aidjytkn' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[138d74e0-2da1-45f8-bf80-f5329db52240]: (4, 'raw') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:31 devstack sudo[104337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:31 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-470370ba-474b-4607-8ec5-fc7ad2b474d4-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:31 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-470370ba-474b-4607-8ec5-fc7ad2b474d4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4" returned: 0 in 0.536s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:31 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD
Aug 29 13:29:31 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:31 devstack sudo[104345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c
Aug 29 13:29:31 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-quobyte-470370ba-474b-4607-8ec5-fc7ad2b474d4" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-470370ba-474b-4607-8ec5-fc7ad2b474d4" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc005a2-1b68-4abf-a04f-d33debff1e01]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:31 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.354s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:31 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Deleted volume successfully.
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d0f28bba-60bc-44df-a177-ca2d9bc1f4bd tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-2aa2447e-0274-4470-916d-b7f6931e41e4-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:31 devstack sudo[104348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4
Aug 29 13:29:31 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:31 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:31 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac" returned: 0 in 0.736s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ef265e46-f218-40af-8f12-4e4c8ae3cc3a_yi0g4sjndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:29:31 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Converted 0.00 MB image at 0.00 MB/s
Aug 29 13:29:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:31 devstack sudo[104356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac 1G
Aug 29 13:29:31 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:31 devstack sudo[104354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD
Aug 29 13:29:31 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:32 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4" returned: 0 in 0.450s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:32 devstack sudo[104364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4
Aug 29 13:29:32 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:32 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac 1G" returned: 0 in 0.517s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Downloaded image ef265e46-f218-40af-8f12-4e4c8ae3cc3a ((None, [{'url': 'file:///opt/stack/data/glance/images/ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'metadata': {}}])) to volume 0a060ead-2dc6-48b5-b8eb-40a98bc94eac successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Temporary image ef265e46-f218-40af-8f12-4e4c8ae3cc3a for user 1f22eec063de4d2e861c385fe11e85fa is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Marking volume 0a060ead-2dc6-48b5-b8eb-40a98bc94eac as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Copying metadata from image ef265e46-f218-40af-8f12-4e4c8ae3cc3a to 0a060ead-2dc6-48b5-b8eb-40a98bc94eac. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Creating volume glance metadata for volume 0a060ead-2dc6-48b5-b8eb-40a98bc94eac backed by image ef265e46-f218-40af-8f12-4e4c8ae3cc3a with: {'image_id': 'ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'acb3d616743eb06cd8662067f1e89250', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:29:32 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD" returned: 1 in 0.700s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] 14487164-1a3f-46af-9c0f-d6d01855b7df was raw, converting to qcow2 {{(pid=85771) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:32 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a
Aug 29 13:29:32 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:32 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-470370ba-474b-4607-8ec5-fc7ad2b474d4" returned: 0 in 0.685s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b17893-0034-4f56-812b-0440ef689017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac', 'volume_size': 1, 'image_id': 'ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'acb3d616743eb06cd8662067f1e89250', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f4937c9f3abb4027b56acab8ca24adac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '799ff2a6fa5a2a68b97454f63e75191b32b2d7ff58c67d8dabff3dca721628c14b6a9a51c2b7b75bb56b4dfa69c21519caabe90fa4bfc98be381152bcce91223', 'id': 'ef265e46-f218-40af-8f12-4e4c8ae3cc3a', 'created_at': datetime.datetime(2026, 8, 29, 11, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 29, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef265e46-f218-40af-8f12-4e4c8ae3cc3a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6165afe60>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d055ed1f-37ea-421e-a54b-36c8ee065024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-470370ba-474b-4607-8ec5-fc7ad2b474d4" released by "delete_volume" :: held 1.263s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:32 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Volume volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac (0a060ead-2dc6-48b5-b8eb-40a98bc94eac): created successfully
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d055ed1f-37ea-421e-a54b-36c8ee065024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Flow 'volume_create_manager' (44428f3f-8560-4aff-90fa-d63512a30c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-872aa425-1e49-4fba-a6d4-0d7df494e230 tempest-VolumeImageDependencyTests-1545993420 None] Created volume successfully.
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Created reservations ['b573b2c7-5fb1-41d0-8528-7b947f2c8fdd', '5a10688c-e90f-4e26-8a3c-5fda8616e19e', '2c446b39-6dd0-439a-875d-b9384f0e7124', '663f7844-ad62-4fbb-9511-d574d1cc21b5'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:33 devstack sudo[104384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:33 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:33 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a" returned: 0 in 1.303s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14487164-1a3f-46af-9c0f-d6d01855b7df_vb6q2yjxdevstack@QuobyteHD, size 0.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:29:33 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Converted 0.00 MB image at 0.00 MB/s
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-b84fb80a-9fde-4cf3-bc08-effa6faead91-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:33 devstack sudo[104389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a 1G
Aug 29 13:29:33 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-b84fb80a-9fde-4cf3-bc08-effa6faead91-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:33 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.704s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:33 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Deleted volume successfully.
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-quobyte-b84fb80a-9fde-4cf3-bc08-effa6faead91" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8251fcb1-adae-4ff2-9305-2afa40e9b8e1 tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-470370ba-474b-4607-8ec5-fc7ad2b474d4-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-b84fb80a-9fde-4cf3-bc08-effa6faead91" acquired by "delete_volume" :: waited 0.046s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09fa615-c8b6-4d62-8f33-0b29a57e9cc8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Acquiring lock "cinder-0a060ead-2dc6-48b5-b8eb-40a98bc94eac-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Lock "cinder-0a060ead-2dc6-48b5-b8eb-40a98bc94eac-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Acquiring lock "cinder-quobyte-0a060ead-2dc6-48b5-b8eb-40a98bc94eac" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:34 devstack sudo[104393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91
Aug 29 13:29:34 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Lock "cinder-quobyte-0a060ead-2dc6-48b5-b8eb-40a98bc94eac" acquired by "delete_volume" :: waited 0.059s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:34 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a 1G" returned: 0 in 0.762s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Downloaded image 14487164-1a3f-46af-9c0f-d6d01855b7df ((None, [{'url': 'file:///opt/stack/data/glance/images/14487164-1a3f-46af-9c0f-d6d01855b7df', 'metadata': {}}])) to volume 7cfba230-9657-4c14-84d7-0547ba03a97a successfully. {{(pid=85771) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Temporary image 14487164-1a3f-46af-9c0f-d6d01855b7df for user 30c8bd701f11497eb0344262bdb3fddb is deleted. {{(pid=85771) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.volume.volume_utils [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Marking volume 7cfba230-9657-4c14-84d7-0547ba03a97a as bootable. {{(pid=85771) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3e5d38-a05a-46bc-913c-6a1338c51548]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Copying metadata from image 14487164-1a3f-46af-9c0f-d6d01855b7df to 7cfba230-9657-4c14-84d7-0547ba03a97a. {{(pid=85771) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Creating volume glance metadata for volume 7cfba230-9657-4c14-84d7-0547ba03a97a backed by image 14487164-1a3f-46af-9c0f-d6d01855b7df with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '14487164-1a3f-46af-9c0f-d6d01855b7df', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '71eb7be795e92730541f42ebb58ad37b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85771) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b8da53-ca85-44bb-b704-095d8ec4539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfba230-9657-4c14-84d7-0547ba03a97a', 'volume_size': 1, 'image_id': '14487164-1a3f-46af-9c0f-d6d01855b7df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14487164-1a3f-46af-9c0f-d6d01855b7df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71eb7be795e92730541f42ebb58ad37b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef0da695a8684f468830e00ea6ba9f3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a3544e20813bf648e3efc602e6a1b46b164fe82553be414588875f8ea3c694c6b2e0cd0633ebb0ddd175a7ea3ad761466bcc6b50a0625f96e9e8131f13f5501', 'id': '14487164-1a3f-46af-9c0f-d6d01855b7df', 'created_at': datetime.datetime(2026, 8, 29, 11, 29, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 29, 11, 29, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14487164-1a3f-46af-9c0f-d6d01855b7df/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b6166288c0>}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df490210-16d5-4a5b-992b-24299ed02adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:34 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Volume volume-7cfba230-9657-4c14-84d7-0547ba03a97a (7cfba230-9657-4c14-84d7-0547ba03a97a): created successfully
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df490210-16d5-4a5b-992b-24299ed02adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Flow 'volume_create_manager' (1cedb092-8871-4276-a760-247e2b32c325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-076b5445-2b20-49cb-8e55-cc0482318881 tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Created volume successfully.
Aug 29 13:29:34 devstack sudo[104396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac
Aug 29 13:29:34 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:35 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91" returned: 0 in 0.882s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:35 devstack sudo[104401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91
Aug 29 13:29:35 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:35 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac" returned: 0 in 0.877s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:35 devstack sudo[104407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac
Aug 29 13:29:35 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:35 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b84fb80a-9fde-4cf3-bc08-effa6faead91" returned: 0 in 0.620s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Acquiring lock "cinder-7cfba230-9657-4c14-84d7-0547ba03a97a-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-b84fb80a-9fde-4cf3-bc08-effa6faead91" released by "delete_volume" :: held 1.694s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "cinder-7cfba230-9657-4c14-84d7-0547ba03a97a-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Acquiring lock "cinder-quobyte-7cfba230-9657-4c14-84d7-0547ba03a97a" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "cinder-quobyte-7cfba230-9657-4c14-84d7-0547ba03a97a" acquired by "delete_volume" :: waited 0.034s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Created reservations ['121ff424-282d-4afa-853e-acd201c002ae', '3643e4df-78ba-4be9-885a-4cca1c97f1a2', 'c5d7bb0d-708f-4622-b55f-d288aee62677', '5eaa8e39-ba8c-4479-abe4-efafb7e9443b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2335c92d-eaf4-4716-968d-ae3fd244ecde]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:36 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0a060ead-2dc6-48b5-b8eb-40a98bc94eac" returned: 0 in 0.661s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Lock "cinder-quobyte-0a060ead-2dc6-48b5-b8eb-40a98bc94eac" released by "delete_volume" :: held 1.669s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:36 devstack sudo[104411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a
Aug 29 13:29:36 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:36 devstack sudo[104413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:36 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-62567071-c3b3-4366-853a-fdb90bf52db7-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Created reservations ['3ff8df9d-04db-4677-8c0f-869b2c85366c', '7cab00e1-6f2a-439a-82bf-88682183d2a3', '35e2a69d-0b22-42be-8e82-bf2f6f5b7b90', '925599d8-2220-4c41-ac9d-3451701e1137'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-62567071-c3b3-4366-853a-fdb90bf52db7-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "cinder-quobyte-62567071-c3b3-4366-853a-fdb90bf52db7" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:36 devstack sudo[104415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-62567071-c3b3-4366-853a-fdb90bf52db7" acquired by "delete_volume" :: waited 0.103s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:36 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2073b114-8ef0-4f65-9227-5f2c57f8158d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:36 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.593s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:36 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:37 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Deleted volume successfully.
Aug 29 13:29:37 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7
Aug 29 13:29:37 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-83551186-411e-4947-bb7b-49785e7f181d tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-b84fb80a-9fde-4cf3-bc08-effa6faead91-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:37 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a" returned: 0 in 1.139s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:37 devstack sudo[104423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a
Aug 29 13:29:37 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:37 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.832s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:37 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Deleted volume successfully.
Aug 29 13:29:37 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7" returned: 0 in 0.720s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:37 devstack sudo[104429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7
Aug 29 13:29:37 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6d0560f5-abd4-4cd8-a1dc-a37bbb8786e3 tempest-VolumeImageDependencyTests-1545993420 None] Lock "cinder-0a060ead-2dc6-48b5-b8eb-40a98bc94eac-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" returned: 0 in 6.439s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:29:37 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Converted 1024.00 MB image at 159.00 MB/s
Aug 29 13:29:37 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c is being set with open permissions: ugo+rw
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:37 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7cfba230-9657-4c14-84d7-0547ba03a97a" returned: 0 in 0.669s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "cinder-quobyte-7cfba230-9657-4c14-84d7-0547ba03a97a" released by "delete_volume" :: held 1.908s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:37 devstack sudo[104432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c
Aug 29 13:29:37 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:37 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-62567071-c3b3-4366-853a-fdb90bf52db7" returned: 0 in 0.422s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-quobyte-62567071-c3b3-4366-853a-fdb90bf52db7" released by "delete_volume" :: held 1.249s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Created reservations ['59150382-bd7d-4fb7-85d2-8347da9bae52', 'e6a54eaf-c213-4518-9f13-5d6f07f151e2', '2060a9e5-92f8-4e6c-9870-0a2f55adaddc', 'a7a7d55b-2b4a-40e2-bac0-2c14b4d0a0d5'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Created reservations ['4f11b862-cb09-4111-91eb-bccf4660f129', '3b4bbe03-99f9-45fa-8735-6c06d1738431', '494923b3-6f90-443f-bfa5-ea91ef14d3ab', 'dabf4d08-eb90-46e0-b44b-0ff753412859'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:38 devstack sudo[104435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:38 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:38 devstack sudo[104437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:38 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:38 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" returned: 0 in 0.396s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" released by "_copy_volume_from_snapshot" :: held 7.925s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-97c95b99-3558-44b0-9441-28df80d8ebbc-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" released by "_create_volume_from_snapshot" :: held 8.025s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.063s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef05c1e-7970-416c-a785-190f5d61a120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c', 'volume_size': 1, 'snapshot_id': '97c95b99-3558-44b0-9441-28df80d8ebbc'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a59afe3-1316-4e4e-a0a7-a68066d2ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:38 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Volume volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c (0d98dbc6-546a-42b4-93fb-6bad3e1d926c): created successfully
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a59afe3-1316-4e4e-a0a7-a68066d2ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Flow 'volume_create_manager' (4317a36c-3c4e-4377-9d68-a62fef1ab286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:38 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.394s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Deleted volume successfully.
Aug 29 13:29:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-cb92997e-1bb6-4e8a-ac80-05e9f38df0b2 tempest-VolumeDependencyTests-341561756 None] Created volume successfully.
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-38b124a3-d2e0-4746-b65b-b1de55d7328a tempest-VolumeAndVolumeTypeFromImageTest-447733092 None] Lock "cinder-7cfba230-9657-4c14-84d7-0547ba03a97a-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:38 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.410s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Deleted volume successfully.
Aug 29 13:29:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-93e45719-7e82-40f0-a5eb-bc382170f3be tempest-CreateVolumesFromImageTest-1325367696 None] Lock "cinder-62567071-c3b3-4366-853a-fdb90bf52db7-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "cinder-97c95b99-3558-44b0-9441-28df80d8ebbc-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-97c95b99-3558-44b0-9441-28df80d8ebbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "cinder-quobyte-a7906661-6030-43ba-9a5f-7e683125cad4" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-a7906661-6030-43ba-9a5f-7e683125cad4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "cinder-quobyte-97c95b99-3558-44b0-9441-28df80d8ebbc" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-97c95b99-3558-44b0-9441-28df80d8ebbc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Deleting offline snapshot 97c95b99-3558-44b0-9441-28df80d8ebbc of volume a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] snapshot_file for this snap is: volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0027cc-2af4-4ef7-9211-3641357546c8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:39 devstack sudo[104443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc
Aug 29 13:29:39 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:39 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc" returned: 0 in 0.512s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7906661-6030-43ba-9a5f-7e683125cad4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0799d6-1e9f-4af4-8036-4a0681255ac9]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:39 devstack sudo[104448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4
Aug 29 13:29:39 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:40 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4" returned: 0 in 0.818s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:40 devstack sudo[104453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc
Aug 29 13:29:40 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:41 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc" returned: 0 in 0.506s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:41 devstack sudo[104459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc
Aug 29 13:29:41 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:41 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4.97c95b99-3558-44b0-9441-28df80d8ebbc" returned: 0 in 0.334s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-97c95b99-3558-44b0-9441-28df80d8ebbc" released by "_delete_snapshot" :: held 2.333s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-a7906661-6030-43ba-9a5f-7e683125cad4" released by "delete_snapshot" :: held 2.367s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:41 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Created reservations ['a02bcba2-64e0-4123-bba3-c7b4ad853fe3', '49be71df-eaf4-423d-b90e-a813b498f345', 'e0d4cc32-f50c-4562-b793-ab6a21279ab0', '7cf229a4-13e0-4f8c-a075-ba9396aeb277'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Delete snapshot completed successfully.
Aug 29 13:29:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4f45a781-4535-4e89-93c3-515ed5f28dd8 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-97c95b99-3558-44b0-9441-28df80d8ebbc-delete_snapshot" released by "delete_snapshot" :: held 2.547s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:42 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f8c6c144-42a4-42e0-9f9f-afb730450394 tempest-ProjectAdminTests-850877636 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5325202941895, 'free_capacity_gb': 1774.5325202941895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85771) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 29 13:29:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Acquiring lock "cinder-a7906661-6030-43ba-9a5f-7e683125cad4-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Lock "cinder-a7906661-6030-43ba-9a5f-7e683125cad4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Acquiring lock "cinder-quobyte-a7906661-6030-43ba-9a5f-7e683125cad4" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:42 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-a7906661-6030-43ba-9a5f-7e683125cad4" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:42 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20d2cc4-9156-448f-91e0-4c75cba79e2b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:42 devstack sudo[104468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4
Aug 29 13:29:42 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:42 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4" returned: 0 in 0.398s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:42 devstack sudo[104473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4
Aug 29 13:29:42 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:43 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a7906661-6030-43ba-9a5f-7e683125cad4" returned: 0 in 0.301s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-a7906661-6030-43ba-9a5f-7e683125cad4" released by "delete_volume" :: held 0.780s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Created reservations ['306ba637-7ff1-4f63-ba87-e3aaeefca689', '1af46aaa-9fea-4f94-aae5-6c32764d058f', 'f5411329-22d3-41b7-add5-024bab613a75', '8f1818a0-ec12-4a94-8085-919fd70f60dd'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:43 devstack sudo[104477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:43 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (667d0904-5814-4ba0-ae7d-7d1e782bda2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afa8935-e296-4a42-9fb4-15b4dd38c2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "cinder-0d98dbc6-546a-42b4-93fb-6bad3e1d926c-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afa8935-e296-4a42-9fb4-15b4dd38c2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312741638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0603dae7-0788-4092-ab65-d03721b35899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:44Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bd5407-0ad1-4dc2-9c48-e9be55639fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bd5407-0ad1-4dc2-9c48-e9be55639fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e45f4e5-892f-438e-84fe-4f00d16153ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e45f4e5-892f-438e-84fe-4f00d16153ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0603dae7-0788-4092-ab65-d03721b35899', 'volume_name': 'volume-0603dae7-0788-4092-ab65-d03721b35899', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e75378d-a15d-4979-b626-a84a63c0d677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e75378d-a15d-4979-b626-a84a63c0d677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ded861e-1fd0-4178-96c8-a21aad97dec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:43 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume 0603dae7-0788-4092-ab65-d03721b35899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0603dae7-0788-4092-ab65-d03721b35899', 'volume_size': 1}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312741638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0603dae7-0788-4092-ab65-d03721b35899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:44Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Creating volume 0603dae7-0788-4092-ab65-d03721b35899 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:43 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-0d98dbc6-546a-42b4-93fb-6bad3e1d926c-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:43 devstack sudo[104479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899 1073741824
Aug 29 13:29:43 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:43 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.505s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "cinder-quobyte-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:43 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Deleted volume successfully.
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" acquired by "delete_volume" :: waited 0.037s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-89f032b8-17c9-492a-a384-1328da1bb50e tempest-VolumeDependencyTests-341561756 None] Lock "cinder-a7906661-6030-43ba-9a5f-7e683125cad4-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd2e691-6590-43d0-bd58-d5aee6e545b3]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:44 devstack sudo[104482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c
Aug 29 13:29:44 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:44 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" returned: 0 in 0.438s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:44 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899 1073741824" returned: 0 in 0.637s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:44 devstack sudo[104491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c
Aug 29 13:29:44 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:44 devstack sudo[104493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899
Aug 29 13:29:44 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:44 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" returned: 0 in 0.327s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-quobyte-0d98dbc6-546a-42b4-93fb-6bad3e1d926c" released by "delete_volume" :: held 0.844s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Created reservations ['52b79df8-405c-4d9c-8a65-81d92c4e4217', '4f43bf26-314c-4c87-9e74-384dc0efdd0b', '9d1df793-b690-405d-9bd7-b9b93e9e45e8', '7f7f64ff-476e-412b-9f18-670fd0a0b815'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:44 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899" returned: 0 in 0.389s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ded861e-1fd0-4178-96c8-a21aad97dec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0603dae7-0788-4092-ab65-d03721b35899', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8ab7ef-7dca-40f2-99c4-77bb27375ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:44 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume volume-0603dae7-0788-4092-ab65-d03721b35899 (0603dae7-0788-4092-ab65-d03721b35899): created successfully
Aug 29 13:29:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8ab7ef-7dca-40f2-99c4-77bb27375ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (667d0904-5814-4ba0-ae7d-7d1e782bda2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (85113cf8-222b-446c-8675-ab9bd8ba580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01ea10d-0c9c-4c68-80fc-64e8f4d2ee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b59e148c-0c8a-4cce-a826-6fbc2efff0e1 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created volume successfully.
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01ea10d-0c9c-4c68-80fc-64e8f4d2ee74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506785565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d74408d-f8a5-409b-b41a-4b046e255a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:45Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed476630-934e-47ba-be96-d39c4a9fc461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed476630-934e-47ba-be96-d39c4a9fc461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21447b38-7d66-4f37-842a-08e60e665bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21447b38-7d66-4f37-842a-08e60e665bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d74408d-f8a5-409b-b41a-4b046e255a89', 'volume_name': 'volume-6d74408d-f8a5-409b-b41a-4b046e255a89', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b321cad-9331-416f-a525-8630562b89d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b321cad-9331-416f-a525-8630562b89d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d317eb-a344-494f-9381-4aa4fd854589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:45 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume 6d74408d-f8a5-409b-b41a-4b046e255a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d74408d-f8a5-409b-b41a-4b046e255a89', 'volume_size': 1}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506785565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d74408d-f8a5-409b-b41a-4b046e255a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:45Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Creating volume 6d74408d-f8a5-409b-b41a-4b046e255a89 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:45 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:45 devstack sudo[104497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89 1073741824
Aug 29 13:29:45 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:45 devstack sudo[104498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:45 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:45 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.285s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Deleted volume successfully.
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9ede2a5d-4645-4797-9840-66e805f7d5d7 tempest-VolumeDependencyTests-341561756 None] Lock "cinder-0d98dbc6-546a-42b4-93fb-6bad3e1d926c-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:45 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89 1073741824" returned: 0 in 0.482s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:45 devstack sudo[104506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89
Aug 29 13:29:45 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:45 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d317eb-a344-494f-9381-4aa4fd854589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d74408d-f8a5-409b-b41a-4b046e255a89', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d11325-3717-4ac9-a748-865d5921ade7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:45 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume volume-6d74408d-f8a5-409b-b41a-4b046e255a89 (6d74408d-f8a5-409b-b41a-4b046e255a89): created successfully
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d11325-3717-4ac9-a748-865d5921ade7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (85113cf8-222b-446c-8675-ab9bd8ba580e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4563241d-74be-4142-bd5d-4cebead059f1 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created volume successfully.
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (20101bf0-aa30-4c2a-a92f-46d39fe8b549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86506568-df03-442b-802e-416046305cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86506568-df03-442b-802e-416046305cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-900406247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0851f0e-0ab3-4aca-98f9-de89dc8fbd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:46Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196fcee3-e6e0-453c-9b19-7ec9ac784ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196fcee3-e6e0-453c-9b19-7ec9ac784ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b819e17-511e-4681-94b0-542667bb760f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b819e17-511e-4681-94b0-542667bb760f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0851f0e-0ab3-4aca-98f9-de89dc8fbd56', 'volume_name': 'volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd56bb1-f06c-44ba-ada2-173b595156fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd56bb1-f06c-44ba-ada2-173b595156fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b353fd-3c23-448f-ac28-263281979ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume a0851f0e-0ab3-4aca-98f9-de89dc8fbd56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56', 'volume_size': 1}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-900406247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0851f0e-0ab3-4aca-98f9-de89dc8fbd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:46Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Creating volume a0851f0e-0ab3-4aca-98f9-de89dc8fbd56 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:46 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:46 devstack sudo[104509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56 1073741824
Aug 29 13:29:46 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (1eaf00d4-1aad-4cce-b07b-ae7748bdfe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3926c2a4-cdc2-4477-bd38-d8df58d8a754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3926c2a4-cdc2-4477-bd38-d8df58d8a754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32232212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1019f21a-7f2d-4175-851a-c5052be0bbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:47Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654e8563-c118-4a53-b9c2-caa965232377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654e8563-c118-4a53-b9c2-caa965232377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18687c82-c0ae-412e-9ac7-48f4f78805ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18687c82-c0ae-412e-9ac7-48f4f78805ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1019f21a-7f2d-4175-851a-c5052be0bbcd', 'volume_name': 'volume-1019f21a-7f2d-4175-851a-c5052be0bbcd', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac48abe6-b42d-4890-9eef-936bfa3e74e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac48abe6-b42d-4890-9eef-936bfa3e74e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f8e6be-0cc1-42fa-b4d1-f0cf484f0da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:46 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume 1019f21a-7f2d-4175-851a-c5052be0bbcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1019f21a-7f2d-4175-851a-c5052be0bbcd', 'volume_size': 1}
Aug 29 13:29:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:47 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56 1073741824" returned: 0 in 0.956s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (ba70e499-9e70-44d4-bde8-1bb90a57bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a818f9-2da0-4f3d-8a76-10ec49367c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a818f9-2da0-4f3d-8a76-10ec49367c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575087684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21d3bf1-920e-4961-9902-242798bb55be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:47Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9627b65-84c7-4879-bd74-0dc322c24a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9627b65-84c7-4879-bd74-0dc322c24a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebaf7a5-1cfe-4e83-a25c-394eb93d44dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebaf7a5-1cfe-4e83-a25c-394eb93d44dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21d3bf1-920e-4961-9902-242798bb55be', 'volume_name': 'volume-f21d3bf1-920e-4961-9902-242798bb55be', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecd7199-f04c-4c86-a618-2d830ebaabbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecd7199-f04c-4c86-a618-2d830ebaabbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea636c0-9ee2-42d5-afb2-7198ca814b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:47 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume f21d3bf1-920e-4961-9902-242798bb55be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21d3bf1-920e-4961-9902-242798bb55be', 'volume_size': 1}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:47 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:47 devstack sudo[104516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56
Aug 29 13:29:47 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:48 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56" returned: 0 in 0.383s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32232212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1019f21a-7f2d-4175-851a-c5052be0bbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:47Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Creating volume 1019f21a-7f2d-4175-851a-c5052be0bbcd {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:48 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b353fd-3c23-448f-ac28-263281979ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867b49d8-6cca-4b0d-8d87-52b7266a561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:48 devstack sudo[104519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd 1073741824
Aug 29 13:29:48 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56 (a0851f0e-0ab3-4aca-98f9-de89dc8fbd56): created successfully
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867b49d8-6cca-4b0d-8d87-52b7266a561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:48 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (20101bf0-aa30-4c2a-a92f-46d39fe8b549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:48 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d2f75a47-c5b6-4375-86f0-73ea56890d9a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created volume successfully.
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (2f03e1f2-0b67-4c36-a844-0695fb5bfaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e959413-3776-461e-95ba-0e63dac1bc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e959413-3776-461e-95ba-0e63dac1bc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496551402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562c682e-fcde-4bdd-adde-68ceff755c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:49Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b580c23-d3f2-41c4-8bef-bd4f1db619a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b580c23-d3f2-41c4-8bef-bd4f1db619a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac9876-e293-4469-8500-bb6f2444a3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac9876-e293-4469-8500-bb6f2444a3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '562c682e-fcde-4bdd-adde-68ceff755c94', 'volume_name': 'volume-562c682e-fcde-4bdd-adde-68ceff755c94', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bcc119-45f8-4151-8fe6-f0f57d643546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bcc119-45f8-4151-8fe6-f0f57d643546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b420d9-8d79-4938-816e-3a93b3cddbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:48 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume 562c682e-fcde-4bdd-adde-68ceff755c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-562c682e-fcde-4bdd-adde-68ceff755c94', 'volume_size': 1}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:48 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd 1073741824" returned: 0 in 0.645s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:48 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:48 devstack sudo[104525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd
Aug 29 13:29:48 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (0d57d8e5-6755-42fb-83bf-1c1b6e42297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b4c736-4c54-440d-b805-fd5fee532937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b4c736-4c54-440d-b805-fd5fee532937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601554610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a17ba58-c1f7-46fb-a2ba-8240c7b21254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:49Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8f7330-c5cb-409b-869c-5ba5b6dba43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8f7330-c5cb-409b-869c-5ba5b6dba43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4eaefa9-adf0-4207-8580-e7dc37e0c33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4eaefa9-adf0-4207-8580-e7dc37e0c33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a17ba58-c1f7-46fb-a2ba-8240c7b21254', 'volume_name': 'volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52a0ac1-f68c-4977-941c-e358346a0c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52a0ac1-f68c-4977-941c-e358346a0c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed4d324-605b-43dc-97f0-6a77a00af747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:49 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume 2a17ba58-c1f7-46fb-a2ba-8240c7b21254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254', 'volume_size': 1}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:49 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd" returned: 0 in 0.312s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575087684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21d3bf1-920e-4961-9902-242798bb55be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:47Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Creating volume f21d3bf1-920e-4961-9902-242798bb55be {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:49 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f8e6be-0cc1-42fa-b4d1-f0cf484f0da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1019f21a-7f2d-4175-851a-c5052be0bbcd', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:49 devstack sudo[104528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be 1073741824
Aug 29 13:29:49 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dad6e2-3d61-4b2a-8e30-d9862a3e92d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:49 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume volume-1019f21a-7f2d-4175-851a-c5052be0bbcd (1019f21a-7f2d-4175-851a-c5052be0bbcd): created successfully
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dad6e2-3d61-4b2a-8e30-d9862a3e92d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (1eaf00d4-1aad-4cce-b07b-ae7748bdfe1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a370da55-de26-4199-9fa8-7fac4aa881ec tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created volume successfully.
Aug 29 13:29:49 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be 1073741824" returned: 0 in 0.494s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:49 devstack sudo[104534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be
Aug 29 13:29:49 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:49 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be" returned: 0 in 0.289s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.225s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Creating offline snapshot 3823ede7-fcf3-4139-baca-a5b87006da7e of volume 6d74408d-f8a5-409b-b41a-4b046e255a89 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea636c0-9ee2-42d5-afb2-7198ca814b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21d3bf1-920e-4961-9902-242798bb55be', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eef65ee-8ea7-4ab3-8178-4d0463c53c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd83713-e8cf-4375-b3fe-3362ece8e108]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:50 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume volume-f21d3bf1-920e-4961-9902-242798bb55be (f21d3bf1-920e-4961-9902-242798bb55be): created successfully
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eef65ee-8ea7-4ab3-8178-4d0463c53c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (ba70e499-9e70-44d4-bde8-1bb90a57bd69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:50 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e6323097-9ada-4bca-bc9f-02e87e6c648b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created volume successfully.
Aug 29 13:29:50 devstack sudo[104537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89
Aug 29 13:29:50 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Flow 'volume_create_manager' (f3a5aebb-5abb-42fb-abef-71e8e6d130d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc624f8-ac5a-453f-9e6c-637842d91fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc624f8-ac5a-453f-9e6c-637842d91fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9b8495-ecab-4f2c-b35b-1d6ac254b69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236625f5587b4662ad184081c34a8e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:50Z,use_quota=True,user_id='72cb314e0b4849ab87d4cfb346d83bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc1de64-4ffe-4b9c-a16d-4790c16ebab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc1de64-4ffe-4b9c-a16d-4790c16ebab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76c1fae-b2e6-42f8-90db-70d90182da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76c1fae-b2e6-42f8-90db-70d90182da28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9b8495-ecab-4f2c-b35b-1d6ac254b69c', 'volume_name': 'volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c0a2da-a3bc-4fb1-b45b-97f5e8db03eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c0a2da-a3bc-4fb1-b45b-97f5e8db03eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b89cce-a817-4747-acea-2d6aa70ca2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:50 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Volume ee9b8495-ecab-4f2c-b35b-1d6ac254b69c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c', 'volume_size': 1}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:50 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89" returned: 0 in 0.415s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:50 devstack sudo[104542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e 1G
Aug 29 13:29:50 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:50 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e 1G" returned: 0 in 0.387s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d74408d-f8a5-409b-b41a-4b046e255a89 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:50 devstack sudo[104547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d74408d-f8a5-409b-b41a-4b046e255a89 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e
Aug 29 13:29:50 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:51 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d74408d-f8a5-409b-b41a-4b046e255a89 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e" returned: 0 in 0.298s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:51 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e is being set with open permissions: ugo+rw
Aug 29 13:29:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:51 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e
Aug 29 13:29:51 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:51 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e" returned: 0 in 0.265s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:51 devstack sudo[104555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.info
Aug 29 13:29:51 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:51 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.info" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:51 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.info is being set with open permissions: ugo+rw
Aug 29 13:29:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:51 devstack sudo[104558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.info
Aug 29 13:29:51 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:51 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.info" returned: 0 in 0.256s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.257s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496551402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562c682e-fcde-4bdd-adde-68ceff755c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:49Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Creating volume 562c682e-fcde-4bdd-adde-68ceff755c94 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:52 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:52 devstack sudo[104561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94 1073741824
Aug 29 13:29:52 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:52 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a5c4cd3f-89b8-4118-a03a-3f95da06c861 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Create snapshot completed successfully
Aug 29 13:29:52 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94 1073741824" returned: 0 in 0.549s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:52 devstack sudo[104567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94
Aug 29 13:29:52 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (410ce30b-ee8b-46cf-8059-dc83f565a03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3822eeab-a564-4c36-9cc1-63d6ed79ea54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3822eeab-a564-4c36-9cc1-63d6ed79ea54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1893071917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c529e6-9f6e-4628-a5b1-a12c8aca7b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:53Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05680afd-5501-477d-941e-6f7cfa6b3b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05680afd-5501-477d-941e-6f7cfa6b3b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869260d8-578f-4ccd-8b67-0455554d0531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869260d8-578f-4ccd-8b67-0455554d0531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c529e6-9f6e-4628-a5b1-a12c8aca7b28', 'volume_name': 'volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899614cb-efb8-4e3c-8e1b-f5468d9cd355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899614cb-efb8-4e3c-8e1b-f5468d9cd355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:52 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4571aee4-47ac-46a9-aa23-52ec667b8472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume 49c529e6-9f6e-4628-a5b1-a12c8aca7b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28', 'volume_size': 1}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94" returned: 0 in 0.327s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.820s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601554610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a17ba58-c1f7-46fb-a2ba-8240c7b21254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ef85ce07b1425089f60676b6c30c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:49Z,use_quota=True,user_id='0426ad2bab044401991a19aa46d1cb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Creating volume 2a17ba58-c1f7-46fb-a2ba-8240c7b21254 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:52 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b420d9-8d79-4938-816e-3a93b3cddbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-562c682e-fcde-4bdd-adde-68ceff755c94', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8790834-1a4d-454a-9ad9-01474626bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:52 devstack sudo[104570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254 1073741824
Aug 29 13:29:52 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume volume-562c682e-fcde-4bdd-adde-68ceff755c94 (562c682e-fcde-4bdd-adde-68ceff755c94): created successfully
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8790834-1a4d-454a-9ad9-01474626bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (2f03e1f2-0b67-4c36-a844-0695fb5bfaf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:53 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9a0b639c-b1c4-450f-a181-fb37d4af0f4a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created volume successfully.
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (58138f62-b19a-471c-93a4-1e88539cedc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2ed6ec-5ff2-4c21-9f96-fb3b147aa9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2ed6ec-5ff2-4c21-9f96-fb3b147aa9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286706621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ded82c-ed93-4943-ad94-99af2d17e973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:53Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f5112b-ec59-4349-8337-dd7c60282014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f5112b-ec59-4349-8337-dd7c60282014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d50c871-22f0-474e-bd12-a761261b3599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d50c871-22f0-474e-bd12-a761261b3599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ded82c-ed93-4943-ad94-99af2d17e973', 'volume_name': 'volume-f2ded82c-ed93-4943-ad94-99af2d17e973', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d53ddf-249d-4ccf-9e27-da907d07e335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d53ddf-249d-4ccf-9e27-da907d07e335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8d64d9-7375-4fda-9655-9bb94216db49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume f2ded82c-ed93-4943-ad94-99af2d17e973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ded82c-ed93-4943-ad94-99af2d17e973', 'volume_size': 1}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:53 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254 1073741824" returned: 0 in 0.745s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:53 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254
Aug 29 13:29:53 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (e338a732-4147-4ef8-bbeb-72d7c3173c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87787586-afef-48bd-a370-a13e5f9a34eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87787586-afef-48bd-a370-a13e5f9a34eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-540700586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdbf24f-e272-414f-b82a-1f3968ad6381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:54Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6839c30c-05b1-4b9c-9c58-a5ff8e7c025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6839c30c-05b1-4b9c-9c58-a5ff8e7c025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726ff704-ff7d-40a8-933e-cf3aafc79988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726ff704-ff7d-40a8-933e-cf3aafc79988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbdbf24f-e272-414f-b82a-1f3968ad6381', 'volume_name': 'volume-dbdbf24f-e272-414f-b82a-1f3968ad6381', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb317da9-c30b-493d-ad01-bde8119b101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb317da9-c30b-493d-ad01-bde8119b101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768278a8-f328-4545-addb-f6a9061de058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:53 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume dbdbf24f-e272-414f-b82a-1f3968ad6381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbdbf24f-e272-414f-b82a-1f3968ad6381', 'volume_size': 1}
Aug 29 13:29:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:54 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254" returned: 0 in 0.390s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.811s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9b8495-ecab-4f2c-b35b-1d6ac254b69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236625f5587b4662ad184081c34a8e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:50Z,use_quota=True,user_id='72cb314e0b4849ab87d4cfb346d83bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Creating volume ee9b8495-ecab-4f2c-b35b-1d6ac254b69c {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:54 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed4d324-605b-43dc-97f0-6a77a00af747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac68a86-eb54-4fad-9518-b7a746aa73e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack sudo[104580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c 1073741824
Aug 29 13:29:54 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:54 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Volume volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254 (2a17ba58-c1f7-46fb-a2ba-8240c7b21254): created successfully
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac68a86-eb54-4fad-9518-b7a746aa73e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Flow 'volume_create_manager' (0d57d8e5-6755-42fb-83bf-1c1b6e42297d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a4e1cd73-2d12-453e-84a8-2cd82b362c1b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created volume successfully.
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (13bea955-9e3b-47d6-87e5-ac9c7f32adfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622929a9-53a5-42b4-a968-eb08cb3ac48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622929a9-53a5-42b4-a968-eb08cb3ac48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2107749858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b5da5d-fe1d-4599-94e5-16f8b305ef1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:54Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f08c43-c4ce-40e5-ac1a-d6d3115cce3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f08c43-c4ce-40e5-ac1a-d6d3115cce3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df9c1ce-f552-441d-86af-7001725b2f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df9c1ce-f552-441d-86af-7001725b2f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b5da5d-fe1d-4599-94e5-16f8b305ef1e', 'volume_name': 'volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c20424-7c09-4fe2-92e2-6f80d5d14240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c20424-7c09-4fe2-92e2-6f80d5d14240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dc522d-43c1-4c95-8c0f-2541e82efad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume 82b5da5d-fe1d-4599-94e5-16f8b305ef1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e', 'volume_size': 1}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-2a17ba58-c1f7-46fb-a2ba-8240c7b21254-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-2a17ba58-c1f7-46fb-a2ba-8240c7b21254-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:54 devstack sudo[104588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:54 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-quobyte-2a17ba58-c1f7-46fb-a2ba-8240c7b21254" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-2a17ba58-c1f7-46fb-a2ba-8240c7b21254" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa25f1-909b-4c08-8e80-8d59544c15f5]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (cb27e9fc-ea72-4670-b7d5-b49b45c1829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81faf15a-6c3e-4973-aec1-078202d02e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81faf15a-6c3e-4973-aec1-078202d02e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15747130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:55Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7385efc-8edb-4e56-8800-d9cd9f462996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7385efc-8edb-4e56-8800-d9cd9f462996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487e0337-8d65-43b2-8c60-8f15efc6f16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487e0337-8d65-43b2-8c60-8f15efc6f16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee', 'volume_name': 'volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf246e85-7d96-4c1b-88c0-91a8ff58dc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf246e85-7d96-4c1b-88c0-91a8ff58dc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:54 devstack sudo[104590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924c86d9-5b1e-4113-9920-4dc6d42cd621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:54 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee', 'volume_size': 1}
Aug 29 13:29:54 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c 1073741824" returned: 0 in 0.756s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:54 devstack sudo[104593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c
Aug 29 13:29:54 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:54 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.334s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:29:55 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254" returned: 0 in 0.432s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:55 devstack sudo[104599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254
Aug 29 13:29:55 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:55 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.321s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1893071917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c529e6-9f6e-4628-a5b1-a12c8aca7b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:53Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Creating volume 49c529e6-9f6e-4628-a5b1-a12c8aca7b28 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:55 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b89cce-a817-4747-acea-2d6aa70ca2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f8f66f-2016-4995-b198-c5cc3b4758be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:55 devstack sudo[104601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28 1073741824
Aug 29 13:29:55 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:55 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Volume volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c (ee9b8495-ecab-4f2c-b35b-1d6ac254b69c): created successfully
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f8f66f-2016-4995-b198-c5cc3b4758be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Flow 'volume_create_manager' (f3a5aebb-5abb-42fb-abef-71e8e6d130d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:55 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-59089e43-a912-4deb-a52c-7227ddbaa62e tempest-CinderUnicodeTest-1693535077 None] Created volume successfully.
Aug 29 13:29:55 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-2a17ba58-c1f7-46fb-a2ba-8240c7b21254" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-2a17ba58-c1f7-46fb-a2ba-8240c7b21254" released by "delete_volume" :: held 0.805s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created reservations ['ea229a1f-b149-4311-86ba-b093b7959109', 'f078c21f-f5e2-48ed-af93-8d32e472758f', '5a73f4d8-312d-45df-890d-1bd7eef2deea', 'd66cc4dd-b7cc-4b64-90b0-bbaed02c2fbf'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:55 devstack sudo[104607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:55 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-562c682e-fcde-4bdd-adde-68ceff755c94-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-562c682e-fcde-4bdd-adde-68ceff755c94-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:55 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28 1073741824" returned: 0 in 0.662s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-quobyte-562c682e-fcde-4bdd-adde-68ceff755c94" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-562c682e-fcde-4bdd-adde-68ceff755c94" acquired by "delete_volume" :: waited 0.043s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:56 devstack sudo[104609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28
Aug 29 13:29:56 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f938c5-b471-40d1-ae60-4dbbdbc82206]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:56 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.374s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Deleted volume successfully.
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41a61e4-176e-474a-bc90-d0bc365c9ff6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-2a17ba58-c1f7-46fb-a2ba-8240c7b21254-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:56 devstack sudo[104612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94
Aug 29 13:29:56 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:56 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28" returned: 0 in 0.339s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286706621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ded82c-ed93-4943-ad94-99af2d17e973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:53Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Creating volume f2ded82c-ed93-4943-ad94-99af2d17e973 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:56 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4571aee4-47ac-46a9-aa23-52ec667b8472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f942c8da-56eb-4740-a8d0-85596a42d6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:56 devstack sudo[104615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973 1073741824
Aug 29 13:29:56 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:56 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28 (49c529e6-9f6e-4628-a5b1-a12c8aca7b28): created successfully
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f942c8da-56eb-4740-a8d0-85596a42d6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (410ce30b-ee8b-46cf-8059-dc83f565a03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0fd14bff-b133-4b00-8bdc-b90ed234fb14 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created volume successfully.
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Flow 'volume_create_manager' (f0dbfe33-70c7-4492-bfd4-6e0809cea629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8c058c-c319-4fcd-88f7-53a3821e181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8c058c-c319-4fcd-88f7-53a3821e181c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1396525942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8042c0b9-776a-4294-9f34-0d6955d9d181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236625f5587b4662ad184081c34a8e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:56Z,use_quota=True,user_id='72cb314e0b4849ab87d4cfb346d83bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f1ab7a-1fef-4e2e-a2db-25ab49dfd1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f1ab7a-1fef-4e2e-a2db-25ab49dfd1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4f788c-d47a-44f2-af33-845d68d617a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4f788c-d47a-44f2-af33-845d68d617a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8042c0b9-776a-4294-9f34-0d6955d9d181', 'volume_name': 'volume-8042c0b9-776a-4294-9f34-0d6955d9d181', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321cca30-7fc7-47d5-9e41-0d800cabfcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321cca30-7fc7-47d5-9e41-0d800cabfcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b70e0c6-a188-4dc0-921a-cc50c2e33869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:56 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Volume 8042c0b9-776a-4294-9f34-0d6955d9d181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8042c0b9-776a-4294-9f34-0d6955d9d181', 'volume_size': 1}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:56 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94" returned: 0 in 0.552s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:56 devstack sudo[104620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94
Aug 29 13:29:56 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:56 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-562c682e-fcde-4bdd-adde-68ceff755c94" returned: 0 in 0.290s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:56 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973 1073741824" returned: 0 in 0.551s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-562c682e-fcde-4bdd-adde-68ceff755c94" released by "delete_volume" :: held 0.896s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:56 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created reservations ['ac537be2-83a7-42e0-8912-8d937d6492c4', '5b8a8b97-6fea-4e9d-9934-1d45fb4fe8a7', '30770f8c-48fa-4217-a62e-cd2e9c55bc3c', 'b9fd6510-0ed3-4944-9981-dd965ddf2c30'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:56 devstack sudo[104627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973
Aug 29 13:29:56 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:57 devstack sudo[104629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:57 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Flow 'volume_create_manager' (a76c05f8-96bf-4246-bdb2-9cd195776445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41332d8-e4d0-467d-8262-9f1d3554cabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41332d8-e4d0-467d-8262-9f1d3554cabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-255314354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ef32c5-a08c-4b25-b415-be919d1f5323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0202267e5f47ef8c3221ba93fbbcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:57Z,use_quota=True,user_id='37b225cf07664280a7bbf6b59066694b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9b578f-e649-4451-9231-209f6208ad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9b578f-e649-4451-9231-209f6208ad43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdffbe7-5a1a-47a3-84d5-f507e39762ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdffbe7-5a1a-47a3-84d5-f507e39762ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ef32c5-a08c-4b25-b415-be919d1f5323', 'volume_name': 'volume-11ef32c5-a08c-4b25-b415-be919d1f5323', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:57 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892c2cae-22b6-4fec-a80c-0ef6e0a1913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892c2cae-22b6-4fec-a80c-0ef6e0a1913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2993d67d-6b5d-47fc-a54c-7b1727f666ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:57 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Volume 11ef32c5-a08c-4b25-b415-be919d1f5323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ef32c5-a08c-4b25-b415-be919d1f5323', 'volume_size': 1}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973" returned: 0 in 0.306s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.275s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-540700586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdbf24f-e272-414f-b82a-1f3968ad6381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:54Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Creating volume dbdbf24f-e272-414f-b82a-1f3968ad6381 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:57 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8d64d9-7375-4fda-9655-9bb94216db49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ded82c-ed93-4943-ad94-99af2d17e973', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d446423e-3ac4-4eb6-85b8-67baa53cd13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:57 devstack sudo[104632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381 1073741824
Aug 29 13:29:57 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:57 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume volume-f2ded82c-ed93-4943-ad94-99af2d17e973 (f2ded82c-ed93-4943-ad94-99af2d17e973): created successfully
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d446423e-3ac4-4eb6-85b8-67baa53cd13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (58138f62-b19a-471c-93a4-1e88539cedc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:57 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-98c7ec79-dba9-45c4-9fda-ed0c323c9f6e tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created volume successfully.
Aug 29 13:29:57 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.313s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:57 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Deleted volume successfully.
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-66991f2e-494a-4af9-b2d5-a67985c54c90 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-562c682e-fcde-4bdd-adde-68ceff755c94-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:57 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381 1073741824" returned: 0 in 0.432s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:57 devstack sudo[104638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381
Aug 29 13:29:57 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:57 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.520s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2107749858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b5da5d-fe1d-4599-94e5-16f8b305ef1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:54Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Creating volume 82b5da5d-fe1d-4599-94e5-16f8b305ef1e {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:57 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768278a8-f328-4545-addb-f6a9061de058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbdbf24f-e272-414f-b82a-1f3968ad6381', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:58 devstack sudo[104641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e 1073741824
Aug 29 13:29:58 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efae9a0-b58e-442c-b7ae-d877d27ad3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:58 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume volume-dbdbf24f-e272-414f-b82a-1f3968ad6381 (dbdbf24f-e272-414f-b82a-1f3968ad6381): created successfully
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efae9a0-b58e-442c-b7ae-d877d27ad3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (e338a732-4147-4ef8-bbeb-72d7c3173c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:58 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-cdd9333f-5763-451c-bec2-5a77a13b7d03 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created volume successfully.
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-f21d3bf1-920e-4961-9902-242798bb55be-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-f21d3bf1-920e-4961-9902-242798bb55be-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-quobyte-f21d3bf1-920e-4961-9902-242798bb55be" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-f21d3bf1-920e-4961-9902-242798bb55be" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0c6c56-995a-4b8e-88a2-abb9df1d990e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:58 devstack sudo[104646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be
Aug 29 13:29:58 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:58 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e 1073741824" returned: 0 in 0.496s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:58 devstack sudo[104649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e
Aug 29 13:29:58 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:58 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be" returned: 0 in 0.362s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:58 devstack sudo[104654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be
Aug 29 13:29:58 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:58 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e" returned: 0 in 0.252s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.857s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15747130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1417928d4d74f089030d168e04429c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:55Z,use_quota=True,user_id='4e0408a33b3f4ebb96a12ea7358a94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Creating volume c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:58 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:58 devstack sudo[104657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee 1073741824
Aug 29 13:29:58 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dc522d-43c1-4c95-8c0f-2541e82efad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930bb8fe-1436-4813-b328-770916460410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:58 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e (82b5da5d-fe1d-4599-94e5-16f8b305ef1e): created successfully
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930bb8fe-1436-4813-b328-770916460410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (13bea955-9e3b-47d6-87e5-ac9c7f32adfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:58 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-557a691d-0827-421d-a168-696dd8a2cb42 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created volume successfully.
Aug 29 13:29:58 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f21d3bf1-920e-4961-9902-242798bb55be" returned: 0 in 0.265s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-f21d3bf1-920e-4961-9902-242798bb55be" released by "delete_volume" :: held 0.663s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:58 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created reservations ['5c678795-7389-4bb4-814e-6db3d25be246', 'bfe29131-9e02-4ef2-a9bb-9ac5b1760907', '9efcf6f3-4689-46de-84af-1efe6b25bdbd', '16dfc49d-580f-4c91-9f17-69023d4ad98c'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:59 devstack sudo[104663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:29:59 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:59 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee 1073741824" returned: 0 in 0.478s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:59 devstack sudo[104667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee
Aug 29 13:29:59 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:59 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:29:59 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Deleted volume successfully.
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-1019f21a-7f2d-4175-851a-c5052be0bbcd-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-d8d9b9c6-e266-4607-987a-b9eea521475a tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-f21d3bf1-920e-4961-9902-242798bb55be-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-1019f21a-7f2d-4175-851a-c5052be0bbcd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-quobyte-1019f21a-7f2d-4175-851a-c5052be0bbcd" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-1019f21a-7f2d-4175-851a-c5052be0bbcd" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d954c2-affe-41a3-b0e6-8fbf945f9dc1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:59 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee" returned: 0 in 0.277s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.998s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1396525942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8042c0b9-776a-4294-9f34-0d6955d9d181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236625f5587b4662ad184081c34a8e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:56Z,use_quota=True,user_id='72cb314e0b4849ab87d4cfb346d83bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Creating volume 8042c0b9-776a-4294-9f34-0d6955d9d181 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:29:59 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:59 devstack sudo[104669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd
Aug 29 13:29:59 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:59 devstack sudo[104671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181 1073741824
Aug 29 13:29:59 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924c86d9-5b1e-4113-9920-4dc6d42cd621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dccac7b-12d1-498a-858f-22ea9e112d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:29:59 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Volume volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee (c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee): created successfully
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dccac7b-12d1-498a-858f-22ea9e112d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Flow 'volume_create_manager' (cb27e9fc-ea72-4670-b7d5-b49b45c1829a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:29:59 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3ba288fb-9100-473b-9a43-57747795bfde tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created volume successfully.
Aug 29 13:29:59 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd" returned: 0 in 0.370s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:29:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:29:59 devstack sudo[104680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd
Aug 29 13:29:59 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:00 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181 1073741824" returned: 0 in 0.424s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:00 devstack sudo[104683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181
Aug 29 13:30:00 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:00 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-1019f21a-7f2d-4175-851a-c5052be0bbcd" returned: 0 in 0.246s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-1019f21a-7f2d-4175-851a-c5052be0bbcd" released by "delete_volume" :: held 0.665s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created reservations ['b27d401b-6bc6-474e-b376-5cb2a59ed567', '0223b481-35f6-4099-8780-b264834d72b0', '620ad03d-9467-457f-9251-286e40c6c81f', '61396d47-9f5b-4a1e-80e0-30d98cb604d4'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:00 devstack sudo[104686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:00 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:00 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181" returned: 0 in 0.305s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.113s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-255314354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ef32c5-a08c-4b25-b415-be919d1f5323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0202267e5f47ef8c3221ba93fbbcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:29:57Z,use_quota=True,user_id='37b225cf07664280a7bbf6b59066694b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Creating volume 11ef32c5-a08c-4b25-b415-be919d1f5323 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:00 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b70e0c6-a188-4dc0-921a-cc50c2e33869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8042c0b9-776a-4294-9f34-0d6955d9d181', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15abebe6-c10f-48fb-a3c9-410ebb045334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:00 devstack sudo[104689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323 1073741824
Aug 29 13:30:00 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:00 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Volume volume-8042c0b9-776a-4294-9f34-0d6955d9d181 (8042c0b9-776a-4294-9f34-0d6955d9d181): created successfully
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15abebe6-c10f-48fb-a3c9-410ebb045334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Flow 'volume_create_manager' (f0dbfe33-70c7-4492-bfd4-6e0809cea629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ebcf3168-1e70-45ae-a29e-7bfac0b8b8b6 tempest-CinderUnicodeTest-1693535077 None] Created volume successfully.
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-quobyte-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c978a-aac1-42b3-a1fd-431f03bf116a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:00 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.347s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Deleted volume successfully.
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c03d6ab8-7d1a-4187-b974-72aeab5e28d6 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-1019f21a-7f2d-4175-851a-c5052be0bbcd-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-quobyte-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:00 devstack sudo[104692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee
Aug 29 13:30:00 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b30c700-eb74-4ce2-a88b-e62030ed6d0f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:00 devstack sudo[104697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56
Aug 29 13:30:00 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:00 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323 1073741824" returned: 0 in 0.566s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:01 devstack sudo[104699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323
Aug 29 13:30:01 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:01 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee" returned: 0 in 0.584s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:01 devstack sudo[104705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee
Aug 29 13:30:01 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:01 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56" returned: 0 in 0.408s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:01 devstack sudo[104710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56
Aug 29 13:30:01 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:01 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323" returned: 0 in 0.283s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.246s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Creating offline snapshot 8cac7b7d-3571-4bbc-bb8a-1da390f4f90f of volume 8042c0b9-776a-4294-9f34-0d6955d9d181 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2993d67d-6b5d-47fc-a54c-7b1727f666ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ef32c5-a08c-4b25-b415-be919d1f5323', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1db89c-ac28-47c7-8c19-5b48f27f6f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e46986-04b2-427d-b42f-309a53b9f386]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:01 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Volume volume-11ef32c5-a08c-4b25-b415-be919d1f5323 (11ef32c5-a08c-4b25-b415-be919d1f5323): created successfully
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1db89c-ac28-47c7-8c19-5b48f27f6f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Flow 'volume_create_manager' (a76c05f8-96bf-4246-bdb2-9cd195776445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:01 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-458a1732-3af5-4020-ad66-987c5e068b9c tempest-ProjectReaderTests-1820273213 None] Created volume successfully.
Aug 29 13:30:01 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee" returned: 0 in 0.343s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee" released by "delete_volume" :: held 0.989s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:01 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56" returned: 0 in 0.313s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:01 devstack sudo[104712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181
Aug 29 13:30:01 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56" released by "delete_volume" :: held 0.778s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created reservations ['2ecb5a04-31a6-4724-b31a-fe6725773767', '527a1a71-b840-4ec5-8a50-69e4d6af60d0', 'a5189ddb-4419-47f1-a6e8-603efb5d14a1', '894a5679-1530-4ad0-bbf0-244b67a0cfff'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created reservations ['427090d2-d08c-444d-9b98-da30de3c95db', '9139eb24-bcba-476f-b7fc-7d5864c3657e', 'b318e3a2-6ea9-4c4c-b07e-13c118759966', '1e44f892-9d84-4f57-b725-b47d88e8993a'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:01 devstack sudo[104716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:01 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:01 devstack sudo[104719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:01 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-0603dae7-0788-4092-ab65-d03721b35899-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-0603dae7-0788-4092-ab65-d03721b35899-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:01 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181" returned: 0 in 0.515s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "cinder-quobyte-0603dae7-0788-4092-ab65-d03721b35899" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:01 devstack sudo[104724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f 1G
Aug 29 13:30:01 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-0603dae7-0788-4092-ab65-d03721b35899" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed0069e-0435-4766-b577-fc710dc99414]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:01 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.316s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:01 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:01 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Deleted volume successfully.
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-faa7ba2c-78bb-4fb2-bf6a-e38001afb5cb tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-c0e2c1d6-aa9f-4912-b9a6-ef874a8631ee-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:02 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:02 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Deleted volume successfully.
Aug 29 13:30:02 devstack sudo[104727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-79ae37ab-e3f8-4041-ba6a-6a1d927c7d52 tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-a0851f0e-0ab3-4aca-98f9-de89dc8fbd56-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:02 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:02 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f 1G" returned: 0 in 0.481s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8042c0b9-776a-4294-9f34-0d6955d9d181 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:02 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899" returned: 0 in 0.408s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:02 devstack sudo[104736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8042c0b9-776a-4294-9f34-0d6955d9d181 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f
Aug 29 13:30:02 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:02 devstack sudo[104737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899
Aug 29 13:30:02 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-82b5da5d-fe1d-4599-94e5-16f8b305ef1e-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-82b5da5d-fe1d-4599-94e5-16f8b305ef1e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-quobyte-82b5da5d-fe1d-4599-94e5-16f8b305ef1e" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:02 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-0603dae7-0788-4092-ab65-d03721b35899" returned: 0 in 0.314s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-82b5da5d-fe1d-4599-94e5-16f8b305ef1e" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:02 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8042c0b9-776a-4294-9f34-0d6955d9d181 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f" returned: 0 in 0.355s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:02 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f is being set with open permissions: ugo+rw
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-quobyte-0603dae7-0788-4092-ab65-d03721b35899" released by "delete_volume" :: held 0.795s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0ba1b0-31a3-4fe1-904b-95fef3031a3c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:02 devstack sudo[104744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f
Aug 29 13:30:02 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Acquiring lock "cinder-11ef32c5-a08c-4b25-b415-be919d1f5323-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:02 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-11ef32c5-a08c-4b25-b415-be919d1f5323-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:02 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Created reservations ['4568dadc-d6cc-486f-be73-dce9e7a7423e', '4bbcd882-f8a3-47c5-a3be-ee2ee130ccbc', '9516e14a-76d1-427f-a211-91cbef8810cf', '7fb8296a-92d1-4f44-bcb3-98dbe71322ee'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Acquiring lock "cinder-quobyte-11ef32c5-a08c-4b25-b415-be919d1f5323" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-quobyte-11ef32c5-a08c-4b25-b415-be919d1f5323" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d580c5c7-efc9-48ce-a98e-c05a16236a2e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:03 devstack sudo[104750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:03 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:03 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f" returned: 0 in 0.360s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:03 devstack sudo[104749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323
Aug 29 13:30:03 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:03 devstack sudo[104754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.info
Aug 29 13:30:03 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:03 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e" returned: 0 in 0.477s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:03 devstack sudo[104758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e
Aug 29 13:30:03 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:03 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.448s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:03 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Deleted volume successfully.
Aug 29 13:30:03 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-82b5da5d-fe1d-4599-94e5-16f8b305ef1e" returned: 0 in 0.295s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:03 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.info" returned: 0 in 0.397s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:03 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.info is being set with open permissions: ugo+rw
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-82b5da5d-fe1d-4599-94e5-16f8b305ef1e" released by "delete_volume" :: held 0.846s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dc8e9e9-53ab-4465-854d-69522ec5799b tempest-CreateVolumesFromSourceVolumeTest-1759181564 None] Lock "cinder-0603dae7-0788-4092-ab65-d03721b35899-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:03 devstack sudo[104767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.info
Aug 29 13:30:03 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:03 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323" returned: 0 in 0.604s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created reservations ['bd19c0f6-68e5-4841-818a-9c4ee56d6751', '97f91b86-f693-41fa-b6bc-ccb1ae8261d1', '6906c097-89a9-4404-9e81-44dee2b72ccc', '76fcc43c-10d3-4c31-a4e9-8433dfbf2154'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:03 devstack sudo[104769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323
Aug 29 13:30:03 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:03 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:03 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:03 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-dbdbf24f-e272-414f-b82a-1f3968ad6381-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.info" returned: 0 in 0.354s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-dbdbf24f-e272-414f-b82a-1f3968ad6381-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:03 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8e40a1c4-4188-4e64-a4b5-89c273ad3143 tempest-CinderUnicodeTest-1693535077 None] Create snapshot completed successfully
Aug 29 13:30:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-quobyte-dbdbf24f-e272-414f-b82a-1f3968ad6381" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:03 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-11ef32c5-a08c-4b25-b415-be919d1f5323" returned: 0 in 0.417s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-dbdbf24f-e272-414f-b82a-1f3968ad6381" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-quobyte-11ef32c5-a08c-4b25-b415-be919d1f5323" released by "delete_volume" :: held 1.101s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[23188b3a-b0bf-4e69-9eab-ceebae6b2bdd]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:04 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.378s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Created reservations ['f365f0d4-5120-46a3-abf7-fdb1324595e1', '7378b47f-41cd-45cb-a5b3-2244c83ebd18', '036c3147-fc5d-4d8d-b708-7321f82d09a0', '3fd891be-6e4b-4beb-9f3b-2725fac7a950'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:04 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Deleted volume successfully.
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c8d88507-7e11-43e0-b793-842a3a6d9ec4 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-82b5da5d-fe1d-4599-94e5-16f8b305ef1e-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:04 devstack sudo[104776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381
Aug 29 13:30:04 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:04 devstack sudo[104778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:04 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "cinder-8cac7b7d-3571-4bbc-bb8a-1da390f4f90f-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-8cac7b7d-3571-4bbc-bb8a-1da390f4f90f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "cinder-quobyte-8042c0b9-776a-4294-9f34-0d6955d9d181" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-quobyte-8042c0b9-776a-4294-9f34-0d6955d9d181" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "cinder-quobyte-8cac7b7d-3571-4bbc-bb8a-1da390f4f90f" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-quobyte-8cac7b7d-3571-4bbc-bb8a-1da390f4f90f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Deleting offline snapshot 8cac7b7d-3571-4bbc-bb8a-1da390f4f90f of volume 8042c0b9-776a-4294-9f34-0d6955d9d181 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] snapshot_file for this snap is: volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fb9eb1-2dca-4cc7-9773-1c2da29bcd50]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:04 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381" returned: 0 in 0.523s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:04 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.348s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:04 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Deleted volume successfully.
Aug 29 13:30:04 devstack sudo[104788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381
Aug 29 13:30:04 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:04 devstack sudo[104783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f
Aug 29 13:30:04 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-5db54de7-1af2-4651-b7b2-3a389964155f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-11ef32c5-a08c-4b25-b415-be919d1f5323-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:04 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-dbdbf24f-e272-414f-b82a-1f3968ad6381" returned: 0 in 0.299s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-dbdbf24f-e272-414f-b82a-1f3968ad6381" released by "delete_volume" :: held 0.876s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:04 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f" returned: 0 in 0.475s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8042c0b9-776a-4294-9f34-0d6955d9d181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e99ee1-37d1-4ee6-a775-adb92a23bff8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:04 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created reservations ['dc564bb9-638d-4a78-a9fd-576c5a40d7b6', 'e040abd6-d7d6-4277-98f8-1831e14f37d5', '469bdead-a482-4c55-b4bf-d752d9fcfe99', '8b8fabd4-ee6e-417b-9358-a15587931b14'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:05 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:05 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:05 devstack sudo[104795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181
Aug 29 13:30:05 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:05 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.359s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Deleted volume successfully.
Aug 29 13:30:05 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181" returned: 0 in 0.508s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-9cd3fe9f-c7e3-4275-916f-85138ba5f9bc tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-dbdbf24f-e272-414f-b82a-1f3968ad6381-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:05 devstack sudo[104803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f
Aug 29 13:30:05 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Flow 'volume_create_manager' (3b79a301-a64c-447f-97a4-1f0f6e07c58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df77fd0-acca-4444-92f2-af72f822297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df77fd0-acca-4444-92f2-af72f822297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769727352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca0eb51-cc4d-4cba-914d-fb50686b9e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0202267e5f47ef8c3221ba93fbbcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:06Z,use_quota=True,user_id='37b225cf07664280a7bbf6b59066694b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269a2d62-6351-4a9d-9389-580eef2ec6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269a2d62-6351-4a9d-9389-580eef2ec6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816f58fd-dbe4-4426-898a-e290a95cd238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816f58fd-dbe4-4426-898a-e290a95cd238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca0eb51-cc4d-4cba-914d-fb50686b9e62', 'volume_name': 'volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ff2fbb-bd44-4c78-8845-a7d8e5089cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ff2fbb-bd44-4c78-8845-a7d8e5089cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4439c2c1-5bce-4d6f-b220-57ed1d3b247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:05 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Volume 7ca0eb51-cc4d-4cba-914d-fb50686b9e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62', 'volume_size': 1}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769727352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca0eb51-cc4d-4cba-914d-fb50686b9e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0202267e5f47ef8c3221ba93fbbcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:06Z,use_quota=True,user_id='37b225cf07664280a7bbf6b59066694b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Creating volume 7ca0eb51-cc4d-4cba-914d-fb50686b9e62 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:05 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:05 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62 1073741824
Aug 29 13:30:05 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:05 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f" returned: 0 in 0.358s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:05 devstack sudo[104811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f
Aug 29 13:30:05 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:06 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181.8cac7b7d-3571-4bbc-bb8a-1da390f4f90f" returned: 0 in 0.311s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-f2ded82c-ed93-4943-ad94-99af2d17e973-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-f2ded82c-ed93-4943-ad94-99af2d17e973-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-quobyte-8cac7b7d-3571-4bbc-bb8a-1da390f4f90f" released by "_delete_snapshot" :: held 1.852s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-quobyte-8042c0b9-776a-4294-9f34-0d6955d9d181" released by "delete_snapshot" :: held 1.892s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-quobyte-f2ded82c-ed93-4943-ad94-99af2d17e973" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:06 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-f2ded82c-ed93-4943-ad94-99af2d17e973" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62 1073741824" returned: 0 in 0.566s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[383268be-76f9-486f-a8c6-c1e12031dc76]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Created reservations ['25415f00-dcb0-419a-8976-d6782dbcb3fe', 'ddc66364-24d2-4c3e-82b4-f30a7060d4fe', 'dca5fb0c-3c36-4870-a2c9-4c095898f13a', 'f3cd03c9-3bdc-4478-b1b8-92e1cf26d186'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:06 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62
Aug 29 13:30:06 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:06 devstack sudo[104818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973
Aug 29 13:30:06 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Delete snapshot completed successfully.
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2dd817f1-4368-49f1-8ad6-bcd8c45e51c8 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-8cac7b7d-3571-4bbc-bb8a-1da390f4f90f-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:06 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62" returned: 0 in 0.309s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4439c2c1-5bce-4d6f-b220-57ed1d3b247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca827f8-a967-48dd-acc0-2134464fee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:06 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Volume volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62 (7ca0eb51-cc4d-4cba-914d-fb50686b9e62): created successfully
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca827f8-a967-48dd-acc0-2134464fee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:06 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Flow 'volume_create_manager' (3b79a301-a64c-447f-97a4-1f0f6e07c58f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973" returned: 0 in 0.421s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e129459b-656f-4457-8cd2-845eae101f6a tempest-ProjectReaderTests-1820273213 None] Created volume successfully.
Aug 29 13:30:06 devstack sudo[104826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973
Aug 29 13:30:06 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:07 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f2ded82c-ed93-4943-ad94-99af2d17e973" returned: 0 in 0.274s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-f2ded82c-ed93-4943-ad94-99af2d17e973" released by "delete_volume" :: held 0.739s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created reservations ['9f59a729-1212-4f3c-94a0-7ff9f4797794', '2c6f557e-e3b1-4c8d-8f1a-2a3e2780a31f', '16cb1c2c-b842-4ceb-8138-47f9b77e8307', 'a63d8b81-36f8-4b6f-ade9-d38ce2428dfb'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:07 devstack sudo[104831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:07 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-49c529e6-9f6e-4628-a5b1-a12c8aca7b28-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-49c529e6-9f6e-4628-a5b1-a12c8aca7b28-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-quobyte-49c529e6-9f6e-4628-a5b1-a12c8aca7b28" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-49c529e6-9f6e-4628-a5b1-a12c8aca7b28" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "cinder-8042c0b9-776a-4294-9f34-0d6955d9d181-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-8042c0b9-776a-4294-9f34-0d6955d9d181-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.375s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:07 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb8570d-6862-4f89-99d2-ee22824ca4f1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Deleted volume successfully.
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "cinder-quobyte-8042c0b9-776a-4294-9f34-0d6955d9d181" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-f6098829-d7be-43bb-9e40-ae26d392c5b7 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-f2ded82c-ed93-4943-ad94-99af2d17e973-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-quobyte-8042c0b9-776a-4294-9f34-0d6955d9d181" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4492307-1c9f-4265-ba1c-f5db0b1d6806]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:07 devstack sudo[104834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28
Aug 29 13:30:07 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Acquiring lock "cinder-7ca0eb51-cc4d-4cba-914d-fb50686b9e62-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:07 devstack sudo[104835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181
Aug 29 13:30:07 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-7ca0eb51-cc4d-4cba-914d-fb50686b9e62-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Acquiring lock "cinder-quobyte-7ca0eb51-cc4d-4cba-914d-fb50686b9e62" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-quobyte-7ca0eb51-cc4d-4cba-914d-fb50686b9e62" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf9f9cb-3c6f-48a1-86ce-d96b288b947a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:08 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28" returned: 0 in 0.413s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:08 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28
Aug 29 13:30:08 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:08 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62
Aug 29 13:30:08 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:08 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181" returned: 0 in 0.407s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:08 devstack sudo[104848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181
Aug 29 13:30:08 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:08 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-49c529e6-9f6e-4628-a5b1-a12c8aca7b28" returned: 0 in 0.264s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-49c529e6-9f6e-4628-a5b1-a12c8aca7b28" released by "delete_volume" :: held 0.768s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:08 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62" returned: 0 in 0.389s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created reservations ['133d9cbf-5411-45c5-a493-5a57f212423f', '8f8bbba0-77bc-47cd-8575-f0a22de99465', '38978422-d141-4639-b555-b1b644076de3', '140d0077-c550-4354-9441-89db9253a298'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:08 devstack sudo[104854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62
Aug 29 13:30:08 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:08 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8042c0b9-776a-4294-9f34-0d6955d9d181" returned: 0 in 0.315s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:08 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:08 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-quobyte-8042c0b9-776a-4294-9f34-0d6955d9d181" released by "delete_volume" :: held 0.806s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Created reservations ['6fbd2e0c-ec6e-4ecf-b83b-7cb2099b8620', 'c6d63e29-6bbe-49d7-8ffb-ea7868cb8787', '24cfd752-a867-410b-8965-d855f4b479b8', '84bb43a2-4ace-4e0d-abfd-df0368b3f77b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-3823ede7-fcf3-4139-baca-a5b87006da7e-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:08 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7ca0eb51-cc4d-4cba-914d-fb50686b9e62" returned: 0 in 0.301s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-quobyte-7ca0eb51-cc4d-4cba-914d-fb50686b9e62" released by "delete_volume" :: held 0.763s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-3823ede7-fcf3-4139-baca-a5b87006da7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-quobyte-6d74408d-f8a5-409b-b41a-4b046e255a89" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-6d74408d-f8a5-409b-b41a-4b046e255a89" acquired by "delete_snapshot" :: waited 0.058s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-quobyte-3823ede7-fcf3-4139-baca-a5b87006da7e" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:08 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:08 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "cinder-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-3823ede7-fcf3-4139-baca-a5b87006da7e" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Deleting offline snapshot 3823ede7-fcf3-4139-baca-a5b87006da7e of volume 6d74408d-f8a5-409b-b41a-4b046e255a89 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] snapshot_file for this snap is: volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebba8bb-510b-4098-a2ca-e12ae6e3e9dd]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:08 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.465s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Created reservations ['548a0539-8e47-4753-9dd2-a0aa6bbab51a', '64637d70-2eff-4976-ba60-6af108d9a49c', '55df65c0-288a-437a-8fa7-adf4c35df302', 'a4deabe0-e45d-4798-a97b-51ed21e0982b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:08 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Deleted volume successfully.
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db9f3209-c46b-48f5-bd38-099f84eff06d tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-49c529e6-9f6e-4628-a5b1-a12c8aca7b28-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "cinder-quobyte-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-quobyte-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c" acquired by "delete_volume" :: waited 0.050s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:09 devstack sudo[104863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e
Aug 29 13:30:09 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f5f4f3-27b7-4a9f-a140-a98421d9e066]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:09 devstack sudo[104866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:09 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:09 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.431s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Deleted volume successfully.
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-669fe114-d1b7-4b1d-a789-b2d5cc416f4a tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-8042c0b9-776a-4294-9f34-0d6955d9d181-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:09 devstack sudo[104867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c
Aug 29 13:30:09 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:09 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.312s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Deleted volume successfully.
Aug 29 13:30:09 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e" returned: 0 in 0.577s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d74408d-f8a5-409b-b41a-4b046e255a89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1827a214-7972-436c-9fb2-7f9b0e1ef34f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-7ca0eb51-cc4d-4cba-914d-fb50686b9e62-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee839bc2-2249-46dd-9f69-396705d6e5a9]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:09 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c" returned: 0 in 0.437s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:09 devstack sudo[104877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89
Aug 29 13:30:09 devstack sudo[104880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c
Aug 29 13:30:09 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:09 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:09 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89" returned: 0 in 0.383s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:09 devstack sudo[104888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e
Aug 29 13:30:09 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:09 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c" returned: 0 in 0.342s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-quobyte-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c" released by "delete_volume" :: held 0.877s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:09 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Created reservations ['5844fe02-9258-49fe-95bc-075932fec51a', '479edd88-56cc-4823-aee3-807e7d85c644', '23addbc3-cf1f-48ed-bdf7-1388da9831b6', 'ff6c1aeb-dc71-411d-b1b9-622cfef378d4'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:10 devstack sudo[104890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:10 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:10 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e" returned: 0 in 0.367s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:10 devstack sudo[104895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e
Aug 29 13:30:10 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:10 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.270s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Deleted volume successfully.
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-cad41942-31e5-4650-b83b-b3cc01c5dfb3 tempest-CinderUnicodeTest-1693535077 None] Lock "cinder-ee9b8495-ecab-4f2c-b35b-1d6ac254b69c-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:10 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89.3823ede7-fcf3-4139-baca-a5b87006da7e" returned: 0 in 0.282s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-3823ede7-fcf3-4139-baca-a5b87006da7e" released by "_delete_snapshot" :: held 1.754s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-6d74408d-f8a5-409b-b41a-4b046e255a89" released by "delete_snapshot" :: held 1.812s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Flow 'volume_create_manager' (538a3c97-d371-4638-8840-e0e671fb0045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6c9b8f-8aa3-4c8f-ac84-8f912dfba46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6c9b8f-8aa3-4c8f-ac84-8f912dfba46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2096390712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d98ed36-8b0d-426f-b8bd-4d7d4486efb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0202267e5f47ef8c3221ba93fbbcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:11Z,use_quota=True,user_id='37b225cf07664280a7bbf6b59066694b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30799655-162e-4b7a-9920-8fd1e241fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30799655-162e-4b7a-9920-8fd1e241fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bb7f61-d784-46db-80ff-8fae621efb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bb7f61-d784-46db-80ff-8fae621efb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d98ed36-8b0d-426f-b8bd-4d7d4486efb1', 'volume_name': 'volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caff6967-709f-4a39-a6e3-719b4ec4a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caff6967-709f-4a39-a6e3-719b4ec4a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ef9675-8c0b-4c0d-80a6-6e26cf4260ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:10 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Volume 9d98ed36-8b0d-426f-b8bd-4d7d4486efb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1', 'volume_size': 1}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2096390712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d98ed36-8b0d-426f-b8bd-4d7d4486efb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0202267e5f47ef8c3221ba93fbbcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:11Z,use_quota=True,user_id='37b225cf07664280a7bbf6b59066694b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Creating volume 9d98ed36-8b0d-426f-b8bd-4d7d4486efb1 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:10 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created reservations ['bb3d0f93-10c6-476f-93e6-7b944baa9221', 'e23ecbb9-96e1-4504-adcc-31eec70bd779', 'ccb1e544-b6a9-4112-b430-4fd5063e7bb2', 'c3485723-9885-4022-98a0-241862d2a1e5'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:10 devstack sudo[104899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1 1073741824
Aug 29 13:30:10 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Delete snapshot completed successfully.
Aug 29 13:30:10 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-822bb4ec-bef5-4c66-b47b-839118a88f9a tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-3823ede7-fcf3-4139-baca-a5b87006da7e-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:11 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1 1073741824" returned: 0 in 0.583s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:11 devstack sudo[104905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1
Aug 29 13:30:11 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:11 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1" returned: 0 in 0.324s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ef9675-8c0b-4c0d-80a6-6e26cf4260ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9732f18d-f225-4470-b7c1-be0c6fd319d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:11 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Volume volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1 (9d98ed36-8b0d-426f-b8bd-4d7d4486efb1): created successfully
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9732f18d-f225-4470-b7c1-be0c6fd319d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Flow 'volume_create_manager' (538a3c97-d371-4638-8840-e0e671fb0045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:11 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1305207b-c029-4636-9a0f-5d8da1ec439e tempest-ProjectReaderTests-1820273213 None] Created volume successfully.
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-6d74408d-f8a5-409b-b41a-4b046e255a89-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-6d74408d-f8a5-409b-b41a-4b046e255a89-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "cinder-quobyte-6d74408d-f8a5-409b-b41a-4b046e255a89" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-6d74408d-f8a5-409b-b41a-4b046e255a89" acquired by "delete_volume" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd13d32d-ea1a-4163-ad55-1cadf4dd1d3d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:12 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89
Aug 29 13:30:12 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:12 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89" returned: 0 in 0.391s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:12 devstack sudo[104913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89
Aug 29 13:30:12 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:12 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-6d74408d-f8a5-409b-b41a-4b046e255a89" returned: 0 in 0.305s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-quobyte-6d74408d-f8a5-409b-b41a-4b046e255a89" released by "delete_volume" :: held 0.786s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Acquiring lock "cinder-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Created reservations ['5745ed48-7c82-4604-9445-155b5746e209', 'd3fee4fa-f0c7-4818-96cb-dc2441db7582', '0393dd11-ebf3-41d9-90a8-134f01520166', '07c4b316-712b-4d8b-89d2-010c51a90f7b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Lock "cinder-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Acquiring lock "cinder-quobyte-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Lock "cinder-quobyte-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1" acquired by "delete_volume" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a531f2-6563-4ecc-be17-1351560346eb]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:13 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:13 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:13 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1
Aug 29 13:30:13 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:13 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.355s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:13 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Deleted volume successfully.
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-3b3a54c0-352c-4971-9d4e-64c6efadf872 tempest-CreateVolumesFromSnapshotTest-2108870572 None] Lock "cinder-6d74408d-f8a5-409b-b41a-4b046e255a89-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:13 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1" returned: 0 in 0.526s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:13 devstack sudo[104925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1
Aug 29 13:30:13 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:13 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1" returned: 0 in 0.277s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Lock "cinder-quobyte-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1" released by "delete_volume" :: held 0.887s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:13 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Created reservations ['21aea0a8-9296-4793-873f-2d3ff22f22dd', '4c436086-30df-4809-8d2e-0e3a1b2b093d', '108e391d-e39c-450d-854d-baff9126f932', 'd1c4367b-1539-4fb6-a710-deddd7e5edef'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:14 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:14 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:14 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.395s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:14 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Deleted volume successfully.
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-73d113bd-80c3-4d8b-ba2e-f11f4cbfcc14 tempest-ProjectReaderTests-1820273213 None] Lock "cinder-9d98ed36-8b0d-426f-b8bd-4d7d4486efb1-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Flow 'volume_create_manager' (b28b6536-76f5-426c-8c88-fd072d9b8c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9c6750-c83b-4d13-bfc3-4d15c92e89c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9c6750-c83b-4d13-bfc3-4d15c92e89c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794570493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3395dc1-09b9-47ad-b629-3038a0d233bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0202267e5f47ef8c3221ba93fbbcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:15Z,use_quota=True,user_id='37b225cf07664280a7bbf6b59066694b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9708f6cc-8d39-4d61-9d7d-4741917af477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9708f6cc-8d39-4d61-9d7d-4741917af477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50a2799-d31c-471a-a53b-38cedb224fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50a2799-d31c-471a-a53b-38cedb224fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3395dc1-09b9-47ad-b629-3038a0d233bb', 'volume_name': 'volume-a3395dc1-09b9-47ad-b629-3038a0d233bb', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b363bda-a183-4721-9c2b-e131b7c75e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b363bda-a183-4721-9c2b-e131b7c75e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d9b391-cf0d-4841-9096-9b2647ce6cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:14 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Volume a3395dc1-09b9-47ad-b629-3038a0d233bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3395dc1-09b9-47ad-b629-3038a0d233bb', 'volume_size': 1}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794570493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3395dc1-09b9-47ad-b629-3038a0d233bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0202267e5f47ef8c3221ba93fbbcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:15Z,use_quota=True,user_id='37b225cf07664280a7bbf6b59066694b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Creating volume a3395dc1-09b9-47ad-b629-3038a0d233bb {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:14 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:15 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb 1073741824
Aug 29 13:30:15 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:15 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb 1073741824" returned: 0 in 0.673s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:15 devstack sudo[104937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb
Aug 29 13:30:15 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:15 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb" returned: 0 in 0.270s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d9b391-cf0d-4841-9096-9b2647ce6cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3395dc1-09b9-47ad-b629-3038a0d233bb', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aa6435-d7ee-44de-b44e-641573affc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:16 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Volume volume-a3395dc1-09b9-47ad-b629-3038a0d233bb (a3395dc1-09b9-47ad-b629-3038a0d233bb): created successfully
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aa6435-d7ee-44de-b44e-641573affc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Flow 'volume_create_manager' (b28b6536-76f5-426c-8c88-fd072d9b8c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4cf7d72c-42f6-4d70-ba1b-efeac4539a6e tempest-ProjectReaderTests-1820273213 None] Created volume successfully.
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (a44a703a-b055-4973-bfdf-8895d4ed5e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aae1b97-1536-4565-8270-6a5cb151d9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aae1b97-1536-4565-8270-6a5cb151d9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1647834735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95752366-8490-44c3-9399-13daf2021b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:16Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2615d7f-7acd-43f5-9f66-4df483ba9473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2615d7f-7acd-43f5-9f66-4df483ba9473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f9950f-40c8-45dd-b6d0-6dc33454aaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f9950f-40c8-45dd-b6d0-6dc33454aaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95752366-8490-44c3-9399-13daf2021b13', 'volume_name': 'volume-95752366-8490-44c3-9399-13daf2021b13', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db07fa1-c2fe-4ee8-bd54-20edc128eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db07fa1-c2fe-4ee8-bd54-20edc128eae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24141c76-c409-4cc0-8487-decdb401efb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:16 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Volume 95752366-8490-44c3-9399-13daf2021b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95752366-8490-44c3-9399-13daf2021b13', 'volume_size': 1}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1647834735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95752366-8490-44c3-9399-13daf2021b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:16Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Creating volume 95752366-8490-44c3-9399-13daf2021b13 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:16 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:16 devstack sudo[104940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13 1073741824
Aug 29 13:30:16 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Acquiring lock "cinder-a3395dc1-09b9-47ad-b629-3038a0d233bb-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-a3395dc1-09b9-47ad-b629-3038a0d233bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Acquiring lock "cinder-quobyte-a3395dc1-09b9-47ad-b629-3038a0d233bb" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-quobyte-a3395dc1-09b9-47ad-b629-3038a0d233bb" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4b7bf9-88ef-44b1-862a-679c4d91c088]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:17 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13 1073741824" returned: 0 in 0.590s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:17 devstack sudo[104945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb
Aug 29 13:30:17 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:17 devstack sudo[104948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13
Aug 29 13:30:17 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:17 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13" returned: 0 in 0.401s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:17 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb" returned: 0 in 0.578s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:17 devstack sudo[104954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb
Aug 29 13:30:17 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24141c76-c409-4cc0-8487-decdb401efb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95752366-8490-44c3-9399-13daf2021b13', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abaa679-ddc0-43eb-8329-3d05480f3db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:17 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Volume volume-95752366-8490-44c3-9399-13daf2021b13 (95752366-8490-44c3-9399-13daf2021b13): created successfully
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abaa679-ddc0-43eb-8329-3d05480f3db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (a44a703a-b055-4973-bfdf-8895d4ed5e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:17 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f4031617-9768-4319-801a-f713fd912a48 tempest-ProjectMemberTests-936537036 None] Created volume successfully.
Aug 29 13:30:17 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-a3395dc1-09b9-47ad-b629-3038a0d233bb" returned: 0 in 0.263s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-quobyte-a3395dc1-09b9-47ad-b629-3038a0d233bb" released by "delete_volume" :: held 0.891s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:17 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Created reservations ['244dc573-2c89-45b0-8f44-537a8ee29518', '55216b39-b277-4c3f-9c5a-155dc84ac189', 'd0a6b2ac-0ac6-4a0b-80ea-a9a5ac68386d', 'd97ff9bd-bc09-4bcc-b131-89f519a8a831'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:18 devstack sudo[104957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:18 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:18 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.408s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:18 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Deleted volume successfully.
Aug 29 13:30:18 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-c7e01f2d-d2c9-4515-99f3-eba7b522053f tempest-ProjectReaderTests-1820273213 None] Lock "cinder-a3395dc1-09b9-47ad-b629-3038a0d233bb-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:19 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=230,cinder:UPDATE=345,cinder:INSERT=78,cinder:DELETE=27 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:30:19 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=304,cinder:SELECT=233,cinder:INSERT=92,cinder:DELETE=31 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:30:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Creating offline snapshot 795d7d50-000d-4b45-a16d-648608efebe1 of volume 95752366-8490-44c3-9399-13daf2021b13 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:30:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c78f833-8435-42cf-a6dc-30f5cc41ba2c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:19 devstack sudo[104960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13
Aug 29 13:30:19 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:19 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13" returned: 0 in 0.416s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:19 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 1G
Aug 29 13:30:19 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:20 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 1G" returned: 0 in 0.497s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95752366-8490-44c3-9399-13daf2021b13 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:20 devstack sudo[104971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95752366-8490-44c3-9399-13daf2021b13 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1
Aug 29 13:30:20 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:20 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95752366-8490-44c3-9399-13daf2021b13 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1" returned: 0 in 0.353s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:20 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 is being set with open permissions: ugo+rw
Aug 29 13:30:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:20 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1
Aug 29 13:30:20 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:21 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1" returned: 0 in 0.279s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:21 devstack sudo[104979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.info
Aug 29 13:30:21 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:21 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.info" returned: 0 in 0.428s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:21 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.info is being set with open permissions: ugo+rw
Aug 29 13:30:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:21 devstack sudo[104982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.info
Aug 29 13:30:21 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:21 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.info" returned: 0 in 0.274s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:21 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a1d886a3-26d2-494e-b8c2-fc77c6c15c76 tempest-ProjectMemberTests-936537036 None] Create snapshot completed successfully
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-795d7d50-000d-4b45-a16d-648608efebe1-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Lock "cinder-795d7d50-000d-4b45-a16d-648608efebe1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-95752366-8490-44c3-9399-13daf2021b13" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-95752366-8490-44c3-9399-13daf2021b13" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-795d7d50-000d-4b45-a16d-648608efebe1" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-795d7d50-000d-4b45-a16d-648608efebe1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Deleting offline snapshot 795d7d50-000d-4b45-a16d-648608efebe1 of volume 95752366-8490-44c3-9399-13daf2021b13 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] snapshot_file for this snap is: volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6c0444-225f-4bcd-b8a2-0b698b3e8caf]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:22 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1
Aug 29 13:30:22 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:23 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1" returned: 0 in 0.442s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:23 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95752366-8490-44c3-9399-13daf2021b13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:23 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df8451-db56-4d15-b3e1-d086fec9de46]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:23 devstack sudo[104991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13
Aug 29 13:30:23 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:23 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13" returned: 0 in 0.450s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:23 devstack sudo[104997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1
Aug 29 13:30:23 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:24 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1" returned: 0 in 0.447s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:24 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1
Aug 29 13:30:24 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:24 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13.795d7d50-000d-4b45-a16d-648608efebe1" returned: 0 in 0.349s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-795d7d50-000d-4b45-a16d-648608efebe1" released by "_delete_snapshot" :: held 1.884s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-95752366-8490-44c3-9399-13daf2021b13" released by "delete_snapshot" :: held 1.928s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:24 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Created reservations ['df186434-3054-4793-a061-53a391d326c1', 'b1d908ce-e914-4e4d-afcf-11b6f6a5aff8', 'f8adc54f-1b9f-48b7-841f-284475c81b88', '748c2a11-dd11-43d5-9929-62d91dd16a8e'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Delete snapshot completed successfully.
Aug 29 13:30:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-aba48800-b659-4c2b-8eab-ad8762bfc78c tempest-ProjectMemberTests-936537036 None] Lock "cinder-795d7d50-000d-4b45-a16d-648608efebe1-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-95752366-8490-44c3-9399-13daf2021b13-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Lock "cinder-95752366-8490-44c3-9399-13daf2021b13-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-95752366-8490-44c3-9399-13daf2021b13" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-95752366-8490-44c3-9399-13daf2021b13" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:25 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bb180b-1998-4620-aab3-f395e9b54f9c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:25 devstack sudo[105008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13
Aug 29 13:30:25 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:25 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13" returned: 0 in 0.476s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:25 devstack sudo[105015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13
Aug 29 13:30:25 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:25 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95752366-8490-44c3-9399-13daf2021b13" returned: 0 in 0.275s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:25 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-95752366-8490-44c3-9399-13daf2021b13" released by "delete_volume" :: held 0.843s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:25 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Created reservations ['f444e438-d056-4314-ad6d-76520ece30cc', '40c48026-14c3-4bdf-8cb6-83d7ae0dc5a4', 'b0bb5040-eccb-41fc-90c1-5b2cebabd831', '2e20c768-f4ea-4d7d-94e7-8c7aa3749697'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:26 devstack sudo[105018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:26 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:26 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.363s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:26 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Deleted volume successfully.
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-776ab410-e1ca-40d9-a26c-75fd0e0fa724 tempest-ProjectMemberTests-936537036 None] Lock "cinder-95752366-8490-44c3-9399-13daf2021b13-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (4e16007a-0c59-4241-b226-959ee30351cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2255e4-de01-409b-a5b8-44d33a910e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2255e4-de01-409b-a5b8-44d33a910e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976264986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a7de78-6005-4a0d-89df-85a1286bdf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:27Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9207464-012d-4e7b-b9da-18f79efb3ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9207464-012d-4e7b-b9da-18f79efb3ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba638443-b3e5-457b-829d-4c57cae4ec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba638443-b3e5-457b-829d-4c57cae4ec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a7de78-6005-4a0d-89df-85a1286bdf9a', 'volume_name': 'volume-90a7de78-6005-4a0d-89df-85a1286bdf9a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ad3638-1141-43e2-a5f0-8f89dc0c81ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ad3638-1141-43e2-a5f0-8f89dc0c81ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bd844e-7721-4361-821e-813bbefd4318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:26 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Volume 90a7de78-6005-4a0d-89df-85a1286bdf9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a7de78-6005-4a0d-89df-85a1286bdf9a', 'volume_size': 1}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976264986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a7de78-6005-4a0d-89df-85a1286bdf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:27Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Creating volume 90a7de78-6005-4a0d-89df-85a1286bdf9a {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:26 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:26 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:26 devstack sudo[105021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a 1073741824
Aug 29 13:30:26 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:27 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a 1073741824" returned: 0 in 0.625s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:27 devstack sudo[105027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a
Aug 29 13:30:27 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:27 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bd844e-7721-4361-821e-813bbefd4318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a7de78-6005-4a0d-89df-85a1286bdf9a', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d2b30e-43fb-4c34-a321-d8870e91afe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:27 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Volume volume-90a7de78-6005-4a0d-89df-85a1286bdf9a (90a7de78-6005-4a0d-89df-85a1286bdf9a): created successfully
Aug 29 13:30:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d2b30e-43fb-4c34-a321-d8870e91afe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:27 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (4e16007a-0c59-4241-b226-959ee30351cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:27 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-cb0a4642-c615-4042-9516-e4494cbce9b1 tempest-ProjectMemberTests-936537036 None] Created volume successfully.
Aug 29 13:30:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:29 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Creating offline snapshot efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb of volume 90a7de78-6005-4a0d-89df-85a1286bdf9a {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:30:29 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a24bc8-c097-4c89-83f2-711ce1735942]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:29 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a
Aug 29 13:30:29 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:29 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a" returned: 0 in 0.469s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:29 devstack sudo[105071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb 1G
Aug 29 13:30:29 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:30 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb 1G" returned: 0 in 0.462s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90a7de78-6005-4a0d-89df-85a1286bdf9a -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:30 devstack sudo[105077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90a7de78-6005-4a0d-89df-85a1286bdf9a -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb
Aug 29 13:30:30 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:30 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90a7de78-6005-4a0d-89df-85a1286bdf9a -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb" returned: 0 in 0.334s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:30 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb is being set with open permissions: ugo+rw
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:30 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb
Aug 29 13:30:30 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:30 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb" returned: 0 in 0.312s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:30 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.info
Aug 29 13:30:30 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (a6c6a881-3cd3-4a1d-971e-5f4d2790e16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0450749f-4a11-48ff-874d-fdb510a74b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0450749f-4a11-48ff-874d-fdb510a74b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760536014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:31Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9875d574-eda0-4c64-831a-717c1d0cf2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9875d574-eda0-4c64-831a-717c1d0cf2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f75cec-f214-4f0c-82a7-41a151c3d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f75cec-f214-4f0c-82a7-41a151c3d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23', 'volume_name': 'volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992e483d-fc47-4682-8496-ef0ce2f89e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992e483d-fc47-4682-8496-ef0ce2f89e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f1451a-c8e3-451d-accc-44e4baca4a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:30 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Volume f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23', 'volume_size': 1}
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:30 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.info" returned: 0 in 0.267s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:30 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.info is being set with open permissions: ugo+rw
Aug 29 13:30:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:30 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.info
Aug 29 13:30:30 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:31 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.info" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.373s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760536014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:31Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Creating volume f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:31 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:31 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 1073741824
Aug 29 13:30:31 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:31 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-64b58dc9-3193-4342-966b-07b373f5b838 tempest-ProjectMemberTests-936537036 None] Create snapshot completed successfully
Aug 29 13:30:31 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 1073741824" returned: 0 in 0.528s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:31 devstack sudo[105098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23
Aug 29 13:30:31 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:32 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" returned: 0 in 0.252s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f1451a-c8e3-451d-accc-44e4baca4a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34d184f-092f-48b9-ae96-5281e54b11d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:32 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Volume volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 (f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23): created successfully
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34d184f-092f-48b9-ae96-5281e54b11d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (a6c6a881-3cd3-4a1d-971e-5f4d2790e16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c978a1a5-1c4e-4b81-8f90-1387552d372c tempest-ProjectReaderTests-533450984 None] Created volume successfully.
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Lock "cinder-efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-90a7de78-6005-4a0d-89df-85a1286bdf9a" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-90a7de78-6005-4a0d-89df-85a1286bdf9a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Deleting offline snapshot efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb of volume 90a7de78-6005-4a0d-89df-85a1286bdf9a {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] snapshot_file for this snap is: volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2f425b-6ff2-4173-ba0a-b9146ef00173]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:32 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb
Aug 29 13:30:32 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:32 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb" returned: 0 in 0.435s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90a7de78-6005-4a0d-89df-85a1286bdf9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ecb63c-1655-4d5e-8871-bc07d339927e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:32 devstack sudo[105107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a
Aug 29 13:30:32 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Creating offline snapshot 324d256f-c2cb-49d4-afba-4b573624c609 of volume f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc89ddd-dd22-470c-9cf0-836fd2eb290e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:33 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a" returned: 0 in 0.527s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:33 devstack sudo[105113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb
Aug 29 13:30:33 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:33 devstack sudo[105112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23
Aug 29 13:30:33 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:33 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" returned: 0 in 0.442s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:33 devstack sudo[105124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 1G
Aug 29 13:30:33 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:33 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb" returned: 0 in 0.423s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:33 devstack sudo[105126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb
Aug 29 13:30:33 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:34 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a.efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb" returned: 0 in 0.318s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb" released by "_delete_snapshot" :: held 1.874s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-90a7de78-6005-4a0d-89df-85a1286bdf9a" released by "delete_snapshot" :: held 1.905s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:34 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 1G" returned: 0 in 0.553s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:34 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609
Aug 29 13:30:34 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Created reservations ['bdb5c4b1-d738-4406-a899-69db92aba2e2', '314dcf31-f5e5-40a8-92cc-c0b1b22dde2e', 'b1393553-09f0-4feb-8f9d-f2631eb12786', '91b69398-d720-4221-80e3-c127ccfc5b90'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:34 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Delete snapshot completed successfully.
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-13f24043-f641-4477-864e-2007e58f3dd3 tempest-ProjectMemberTests-936537036 None] Lock "cinder-efa1a0a1-c3b7-4806-8eb7-a2f0747efdfb-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-90a7de78-6005-4a0d-89df-85a1286bdf9a-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Lock "cinder-90a7de78-6005-4a0d-89df-85a1286bdf9a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-90a7de78-6005-4a0d-89df-85a1286bdf9a" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-90a7de78-6005-4a0d-89df-85a1286bdf9a" acquired by "delete_volume" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8401af-9aa5-4b05-928e-f36df3308f8f]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:34 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609" returned: 0 in 0.509s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:34 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 is being set with open permissions: ugo+rw
Aug 29 13:30:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:34 devstack sudo[105141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609
Aug 29 13:30:34 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:34 devstack sudo[105140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a
Aug 29 13:30:34 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:35 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609" returned: 0 in 0.304s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:35 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.info
Aug 29 13:30:35 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:35 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a" returned: 0 in 0.474s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:35 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a
Aug 29 13:30:35 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:35 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.info" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:35 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.info is being set with open permissions: ugo+rw
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:35 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.info
Aug 29 13:30:35 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:35 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-90a7de78-6005-4a0d-89df-85a1286bdf9a" returned: 0 in 0.325s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-90a7de78-6005-4a0d-89df-85a1286bdf9a" released by "delete_volume" :: held 0.875s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Created reservations ['8113a1d6-0e45-4e01-a5c1-ac905390cdea', '239c8cdf-2cbd-4bc4-8c85-6f9048dc296e', '57f173b4-b75e-4881-8023-9bd2ec169268', '44290101-5cea-427d-b8d1-a894f27184ee'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:35 devstack sudo[105156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:35 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:35 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.info" returned: 0 in 0.340s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.572s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:35 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8db1e70e-7aa7-4ee3-b441-fe8d92b6e6cf tempest-ProjectReaderTests-533450984 None] Create snapshot completed successfully
Aug 29 13:30:35 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.341s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:35 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Deleted volume successfully.
Aug 29 13:30:35 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-65f73d46-eab1-4f66-90ec-30bc04964e1b tempest-ProjectMemberTests-936537036 None] Lock "cinder-90a7de78-6005-4a0d-89df-85a1286bdf9a-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (2f6a937c-7333-42ca-be12-a45e68a7b97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cef456-7c49-4677-81a6-b0fb7aee1f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cef456-7c49-4677-81a6-b0fb7aee1f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793132672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f36a4f-8cc6-45d1-aa18-f38dce64cf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:36Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f98456b-1315-474c-89ec-e7b9548b8581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f98456b-1315-474c-89ec-e7b9548b8581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597a6c9a-2f09-45ef-b00a-aeb91b5fcab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597a6c9a-2f09-45ef-b00a-aeb91b5fcab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f36a4f-8cc6-45d1-aa18-f38dce64cf52', 'volume_name': 'volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedf10a2-9388-4fab-8901-30d6f6d9f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedf10a2-9388-4fab-8901-30d6f6d9f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4671954-34c7-4289-9ad7-69aa5eba183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:36 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Volume 76f36a4f-8cc6-45d1-aa18-f38dce64cf52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52', 'volume_size': 1}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793132672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f36a4f-8cc6-45d1-aa18-f38dce64cf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:36Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Creating volume 76f36a4f-8cc6-45d1-aa18-f38dce64cf52 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:36 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:36 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 1073741824
Aug 29 13:30:36 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-324d256f-c2cb-49d4-afba-4b573624c609-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Lock "cinder-324d256f-c2cb-49d4-afba-4b573624c609-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" acquired by "delete_snapshot" :: waited 0.052s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-324d256f-c2cb-49d4-afba-4b573624c609" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-324d256f-c2cb-49d4-afba-4b573624c609" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Deleting offline snapshot 324d256f-c2cb-49d4-afba-4b573624c609 of volume f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] snapshot_file for this snap is: volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca08803-04db-4798-bc22-33de77f4e345]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:36 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609
Aug 29 13:30:36 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:36 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 1073741824" returned: 0 in 0.554s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:36 devstack sudo[105168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52
Aug 29 13:30:36 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:37 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609" returned: 0 in 0.423s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e05a325-727b-4b4a-8763-629c4e966f47]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:37 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4671954-34c7-4289-9ad7-69aa5eba183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf66d952-fa4f-4f2b-be78-08b4365edacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:37 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Volume volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 (76f36a4f-8cc6-45d1-aa18-f38dce64cf52): created successfully
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf66d952-fa4f-4f2b-be78-08b4365edacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (2f6a937c-7333-42ca-be12-a45e68a7b97b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:37 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-bc989e31-38a3-4efe-9323-09464813fb3b tempest-ProjectMemberTests-936537036 None] Created volume successfully.
Aug 29 13:30:37 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23
Aug 29 13:30:37 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:37 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" returned: 0 in 0.448s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:37 devstack sudo[105181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609
Aug 29 13:30:37 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Flow 'volume_create_manager' (97c0f08e-3376-4182-831a-f346eab7f84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15634ced-ffe9-4167-aef9-913ab3e4b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15634ced-ffe9-4167-aef9-913ab3e4b112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1278111155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a53a22-927a-4238-8a71-186963a6f84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fea3ae8206b46e09bf52c27d92a5ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:38Z,use_quota=True,user_id='9016917ee07945d18248b64aaceb3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0936977-f447-4fcc-b468-0683f04168b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0936977-f447-4fcc-b468-0683f04168b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a543ecce-f038-4591-aa58-a91e83c4f194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a543ecce-f038-4591-aa58-a91e83c4f194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a53a22-927a-4238-8a71-186963a6f84b', 'volume_name': 'volume-00a53a22-927a-4238-8a71-186963a6f84b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc962f2-d433-4c5b-8738-6c9e68769cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:37 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc962f2-d433-4c5b-8738-6c9e68769cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d1cc8b-5bae-4f87-973f-db9664b9db7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:38 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Volume 00a53a22-927a-4238-8a71-186963a6f84b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a53a22-927a-4238-8a71-186963a6f84b', 'volume_size': 1}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1278111155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a53a22-927a-4238-8a71-186963a6f84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fea3ae8206b46e09bf52c27d92a5ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:38Z,use_quota=True,user_id='9016917ee07945d18248b64aaceb3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Creating volume 00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:38 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:38 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b 1073741824
Aug 29 13:30:38 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:38 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609" returned: 0 in 0.440s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:38 devstack sudo[105189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609
Aug 29 13:30:38 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:38 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23.324d256f-c2cb-49d4-afba-4b573624c609" returned: 0 in 0.288s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-324d256f-c2cb-49d4-afba-4b573624c609" released by "_delete_snapshot" :: held 1.741s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" released by "delete_snapshot" :: held 1.786s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:38 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b 1073741824" returned: 0 in 0.522s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Created reservations ['89b67c49-72d8-4dca-9c52-d004269398e9', '77c0a85a-0856-4c39-85e8-3511ccf245ab', '944b196c-3a26-4226-84e0-3163e8b4b048', '5243b4d1-fc3e-4db8-8ce1-0d42cb2c7d5d'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:38 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b
Aug 29 13:30:38 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:38 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Delete snapshot completed successfully.
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76bdeaf8-a7b4-4c22-922d-bc47a2c2bbd2 tempest-ProjectReaderTests-533450984 None] Lock "cinder-324d256f-c2cb-49d4-afba-4b573624c609-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Lock "cinder-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:38 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b" returned: 0 in 0.285s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.299s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Creating offline snapshot 64616f87-79bc-44cb-b5dc-9858ed3cf812 of volume 76f36a4f-8cc6-45d1-aa18-f38dce64cf52 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d1cc8b-5bae-4f87-973f-db9664b9db7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a53a22-927a-4238-8a71-186963a6f84b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9123759-ce3b-4004-95f5-7c839fa71abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf98cef-931f-4cbb-b397-a102f1283e51]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" acquired by "delete_volume" :: waited 0.053s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:38 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Volume volume-00a53a22-927a-4238-8a71-186963a6f84b (00a53a22-927a-4238-8a71-186963a6f84b): created successfully
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9123759-ce3b-4004-95f5-7c839fa71abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Flow 'volume_create_manager' (97c0f08e-3376-4182-831a-f346eab7f84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1112ff9-3a8a-4429-afdd-3ff727ac6a3b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:39 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a20e0cbc-67b0-4a75-8033-74b0da1ccb3f tempest-SnapshotDependencyTests-1053321493 None] Created volume successfully.
Aug 29 13:30:39 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52
Aug 29 13:30:39 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:39 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23
Aug 29 13:30:39 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:39 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" returned: 0 in 0.395s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:39 devstack sudo[105208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 1G
Aug 29 13:30:39 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:39 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" returned: 0 in 0.395s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:39 devstack sudo[105210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23
Aug 29 13:30:39 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:39 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" returned: 0 in 0.255s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23" released by "delete_volume" :: held 0.718s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Created reservations ['eb1b50aa-4161-45c9-a47f-1535c6a282ae', '9023640d-4614-47b4-9ec2-ea6777930590', '4e011f29-0d30-4f6c-aa15-433aa4b4ee3e', '70f940c1-0735-40f8-b5a3-49cf8ed52289'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:39 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 1G" returned: 0 in 0.437s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:39 devstack sudo[105217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:39 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:39 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:39 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:40 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.278s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Deleted volume successfully.
Aug 29 13:30:40 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-50bdd4a9-7cea-4805-a11d-31cae527a1d1 tempest-ProjectReaderTests-533450984 None] Lock "cinder-f9e434ae-5e9c-4dcc-9f4a-2f1707bb4c23-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812" returned: 0 in 0.369s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:40 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 is being set with open permissions: ugo+rw
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:40 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812
Aug 29 13:30:40 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:40 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812" returned: 0 in 0.301s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:40 devstack sudo[105229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.info
Aug 29 13:30:40 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (89066343-147f-41f0-91e8-7332b492eb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6166e656-d8e7-4963-9525-7e8dc7e3f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6166e656-d8e7-4963-9525-7e8dc7e3f368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028844787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734e96e2-ce5e-4625-81b6-c2e4791b266f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:40Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6a043f-d33d-458d-afc0-b36ee7be0c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6a043f-d33d-458d-afc0-b36ee7be0c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637d984d-4dd7-4b16-ad36-5c8f1e8eef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637d984d-4dd7-4b16-ad36-5c8f1e8eef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734e96e2-ce5e-4625-81b6-c2e4791b266f', 'volume_name': 'volume-734e96e2-ce5e-4625-81b6-c2e4791b266f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068fbd51-f7f6-4e12-a980-a990ff36466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068fbd51-f7f6-4e12-a980-a990ff36466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba843104-bb3b-4817-b28a-283218ea8e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:40 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Volume 734e96e2-ce5e-4625-81b6-c2e4791b266f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734e96e2-ce5e-4625-81b6-c2e4791b266f', 'volume_size': 1}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:40 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.info" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:40 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.info is being set with open permissions: ugo+rw
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:40 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.info
Aug 29 13:30:40 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:40 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.info" returned: 0 in 0.241s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.691s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Creating offline snapshot 475e9cea-2e3c-4d3b-a619-9d431f8a5056 of volume 00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:30:41 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-520ec808-e6a9-4ac2-8adc-daf297d507a7 tempest-ProjectMemberTests-936537036 None] Create snapshot completed successfully
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d2f6f0-5e46-4048-aa58-9b2e77c7bdbb]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:41 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b
Aug 29 13:30:41 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:41 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b" returned: 0 in 0.355s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:41 devstack sudo[105243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 1G
Aug 29 13:30:41 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-64616f87-79bc-44cb-b5dc-9858ed3cf812-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:41 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 1G" returned: 0 in 0.401s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00a53a22-927a-4238-8a71-186963a6f84b -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Lock "cinder-64616f87-79bc-44cb-b5dc-9858ed3cf812-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:41 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00a53a22-927a-4238-8a71-186963a6f84b -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056
Aug 29 13:30:41 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-64616f87-79bc-44cb-b5dc-9858ed3cf812" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-64616f87-79bc-44cb-b5dc-9858ed3cf812" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Deleting offline snapshot 64616f87-79bc-44cb-b5dc-9858ed3cf812 of volume 76f36a4f-8cc6-45d1-aa18-f38dce64cf52 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] snapshot_file for this snap is: volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[242f9a9b-3932-4b0f-8289-1cd9c5e491a7]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:41 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:41 devstack sudo[105254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812
Aug 29 13:30:41 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:42 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00a53a22-927a-4238-8a71-186963a6f84b -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056" returned: 0 in 0.298s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:42 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 is being set with open permissions: ugo+rw
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:42 devstack sudo[105259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056
Aug 29 13:30:42 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:42 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812" returned: 0 in 0.377s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13c1e63-6519-443e-ac61-9c2f689f9586]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:42 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:42 devstack sudo[105264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52
Aug 29 13:30:42 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:42 devstack sudo[105266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.info
Aug 29 13:30:42 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:42 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.info" returned: 0 in 0.261s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:42 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.info is being set with open permissions: ugo+rw
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:42 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" returned: 0 in 0.376s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:42 devstack sudo[105273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.info
Aug 29 13:30:42 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:42 devstack sudo[105274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812
Aug 29 13:30:42 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:42 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.info" returned: 0 in 0.241s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.273s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028844787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734e96e2-ce5e-4625-81b6-c2e4791b266f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:40Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Creating volume 734e96e2-ce5e-4625-81b6-c2e4791b266f {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:42 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:42 devstack sudo[105281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f 1073741824
Aug 29 13:30:42 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:42 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a5faca40-334e-480f-962c-8d41692206d3 tempest-SnapshotDependencyTests-1053321493 None] Create snapshot completed successfully
Aug 29 13:30:42 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812" returned: 0 in 0.347s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:42 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:43 devstack sudo[105284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812
Aug 29 13:30:43 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:43 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52.64616f87-79bc-44cb-b5dc-9858ed3cf812" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-64616f87-79bc-44cb-b5dc-9858ed3cf812" released by "_delete_snapshot" :: held 1.448s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" released by "delete_snapshot" :: held 1.470s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:43 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f 1073741824" returned: 0 in 0.435s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Created reservations ['993ea51d-a9e5-4659-8316-1a9fb0f44738', '57abc913-782f-4bf9-bcb0-6a49a9de3735', '4aeb8d15-c807-44c1-a190-36887baa113d', '044fca57-2012-44d3-ae0f-d9cee5a61f14'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:43 devstack sudo[105291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f
Aug 29 13:30:43 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:43 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Delete snapshot completed successfully.
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-2834d017-287f-4718-8b5b-9f0ca269bf63 tempest-ProjectMemberTests-936537036 None] Lock "cinder-64616f87-79bc-44cb-b5dc-9858ed3cf812-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:43 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f" returned: 0 in 0.265s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba843104-bb3b-4817-b28a-283218ea8e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734e96e2-ce5e-4625-81b6-c2e4791b266f', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da049b35-a2e3-4fe2-af82-d82ac4871498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:43 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Volume volume-734e96e2-ce5e-4625-81b6-c2e4791b266f (734e96e2-ce5e-4625-81b6-c2e4791b266f): created successfully
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da049b35-a2e3-4fe2-af82-d82ac4871498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (89066343-147f-41f0-91e8-7332b492eb09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:43 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ff822dcd-f86f-4010-a6ea-be72e8dd582c tempest-ProjectReaderTests-533450984 None] Created volume successfully.
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-76f36a4f-8cc6-45d1-aa18-f38dce64cf52-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-76f36a4f-8cc6-45d1-aa18-f38dce64cf52-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:43 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4408ac7-d5fa-4c93-aeab-8ff1437f41fd]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Flow 'volume_create_manager' (83ff7dd4-0d8f-4b40-9ab4-bdf8a2556c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2616fe1-2672-44a2-bfa6-e1fa639d6eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2616fe1-2672-44a2-bfa6-e1fa639d6eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fea3ae8206b46e09bf52c27d92a5ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=475e9cea-2e3c-4d3b-a619-9d431f8a5056,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:44Z,use_quota=True,user_id='9016917ee07945d18248b64aaceb3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8df3e42-5de9-47ec-8e4c-fae5db6f8554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8df3e42-5de9-47ec-8e4c-fae5db6f8554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50216e6-373e-48b3-acca-a1797eb26418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50216e6-373e-48b3-acca-a1797eb26418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677', 'volume_name': 'volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677', 'volume_size': 1, 'snapshot_id': '475e9cea-2e3c-4d3b-a619-9d431f8a5056'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3794d5a7-8092-4d3c-bbb7-c0caa29b1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3794d5a7-8092-4d3c-bbb7-c0caa29b1486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:44 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52
Aug 29 13:30:44 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52cf03c-8211-4037-b6c0-f7ca97fe45a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:44 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Volume ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677', 'volume_size': 1, 'snapshot_id': '475e9cea-2e3c-4d3b-a619-9d431f8a5056'}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "cinder-quobyte-475e9cea-2e3c-4d3b-a619-9d431f8a5056-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" by "_create_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-475e9cea-2e3c-4d3b-a619-9d431f8a5056-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Creating volume ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677 from snapshot 475e9cea-2e3c-4d3b-a619-9d431f8a5056 {{(pid=85771) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "cinder-quobyte-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" by "_copy_volume_from_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] snapshot: 475e9cea-2e3c-4d3b-a619-9d431f8a5056, volume: ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677,  {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[98312d7f-05ed-42e7-a21c-23893eb8dd6d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:44 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056
Aug 29 13:30:44 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:44 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:44 devstack sudo[105302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52
Aug 29 13:30:44 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:44 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056" returned: 0 in 0.370s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00a53a22-927a-4238-8a71-186963a6f84b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce61564-1259-408d-84ac-639cfc58eb76]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:44 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-76f36a4f-8cc6-45d1-aa18-f38dce64cf52" released by "delete_volume" :: held 0.707s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Created reservations ['cc1f05b0-0ae0-4cde-884e-fa517260965b', 'ac3ed78b-70ee-4f0e-bb40-463515bf562f', '0bb5fe79-7cfd-487f-84d5-630e06fc2e13', 'f9ee7af4-bdfe-43ea-832b-2efeb3f6012a'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:44 devstack sudo[105308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b
Aug 29 13:30:44 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:44 devstack sudo[105310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:44 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:44 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:45 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b" returned: 0 in 0.423s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] will copy from snapshot at /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Creating direct copy from snapshot {{(pid=85771) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.utils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Path /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677 not found in is_blk_device check {{(pid=85771) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:45 devstack sudo[105317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677
Aug 29 13:30:45 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:45 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.264s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:45 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Deleted volume successfully.
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b647b671-0cc7-4f60-97cf-77c3b2ae07f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-76f36a4f-8cc6-45d1-aa18-f38dce64cf52-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (1c9033ef-5445-4feb-9152-9c26cab78015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df45afbd-5a82-4a5e-9355-44ebd237ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df45afbd-5a82-4a5e-9355-44ebd237ce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758158382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:46Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eaa5a25-956e-4ebc-96a3-a9bb1cb32aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eaa5a25-956e-4ebc-96a3-a9bb1cb32aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:45 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ecc3e6-80be-445b-b60f-a58e5ac81cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ecc3e6-80be-445b-b60f-a58e5ac81cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c', 'volume_name': 'volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4f0601-317d-446e-98a8-f031c049bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4f0601-317d-446e-98a8-f031c049bd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:46 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffad1f41-5f1a-4d63-9c2e-f4d4d9e835e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:46 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Volume 4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c', 'volume_size': 1}
Aug 29 13:30:46 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:49 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" returned: 0 in 4.364s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG cinder.image.image_utils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Image conversion details: src /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677 {{(pid=85771) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 29 13:30:49 devstack cinder-volume[85771]: INFO cinder.image.image_utils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Converted 1024.00 MB image at 234.60 MB/s
Aug 29 13:30:49 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677 is being set with open permissions: ugo+rw
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:49 devstack sudo[105331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677
Aug 29 13:30:49 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:49 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" returned: 0 in 0.238s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" released by "_copy_volume_from_snapshot" :: held 5.480s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-475e9cea-2e3c-4d3b-a619-9d431f8a5056-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" released by "_create_volume_from_snapshot" :: held 5.546s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.568s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.830s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Creating offline snapshot 5a334e0c-c482-4f52-b30d-02dc505354ac of volume 734e96e2-ce5e-4625-81b6-c2e4791b266f {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52cf03c-8211-4037-b6c0-f7ca97fe45a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677', 'volume_size': 1, 'snapshot_id': '475e9cea-2e3c-4d3b-a619-9d431f8a5056'}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b65a46-6892-48d8-8ef5-3039e19bbed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e1a00e-16a2-4a73-bbb2-7b7ef31f78b8]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:49 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Volume volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677 (ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677): created successfully
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b65a46-6892-48d8-8ef5-3039e19bbed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:49 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Flow 'volume_create_manager' (83ff7dd4-0d8f-4b40-9ab4-bdf8a2556c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:49 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-167fefb5-6413-4332-895f-d6f49cefd8f7 tempest-SnapshotDependencyTests-1053321493 None] Created volume successfully.
Aug 29 13:30:49 devstack sudo[105334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f
Aug 29 13:30:49 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:50 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f" returned: 0 in 0.354s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:50 devstack sudo[105339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac 1G
Aug 29 13:30:50 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:50 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac 1G" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734e96e2-ce5e-4625-81b6-c2e4791b266f -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:50 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734e96e2-ce5e-4625-81b6-c2e4791b266f -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac
Aug 29 13:30:50 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "cinder-475e9cea-2e3c-4d3b-a619-9d431f8a5056-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-475e9cea-2e3c-4d3b-a619-9d431f8a5056-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "cinder-quobyte-00a53a22-927a-4238-8a71-186963a6f84b" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-00a53a22-927a-4238-8a71-186963a6f84b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "cinder-quobyte-475e9cea-2e3c-4d3b-a619-9d431f8a5056" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-475e9cea-2e3c-4d3b-a619-9d431f8a5056" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Deleting offline snapshot 475e9cea-2e3c-4d3b-a619-9d431f8a5056 of volume 00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] snapshot_file for this snap is: volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90b0752-ce22-4db7-9b30-340df1a2677e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:50 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734e96e2-ce5e-4625-81b6-c2e4791b266f -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac" returned: 0 in 0.322s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:50 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac is being set with open permissions: ugo+rw
Aug 29 13:30:50 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:50 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac
Aug 29 13:30:50 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:50 devstack sudo[105349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056
Aug 29 13:30:50 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:51 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac" returned: 0 in 0.241s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:51 devstack sudo[105354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.info
Aug 29 13:30:51 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:51 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056" returned: 0 in 0.367s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00a53a22-927a-4238-8a71-186963a6f84b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d74e8e-38f4-4200-81c0-ea322fe6e2e3]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:51 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b
Aug 29 13:30:51 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:51 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.info" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:51 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.info is being set with open permissions: ugo+rw
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:51 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.info
Aug 29 13:30:51 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:51 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.info" returned: 0 in 0.243s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.506s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758158382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:46Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Creating volume 4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:51 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:51 devstack sudo[105367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c 1073741824
Aug 29 13:30:51 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:51 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e131f4e6-e77a-42cb-97d7-e7bbf740e938 tempest-ProjectReaderTests-533450984 None] Create snapshot completed successfully
Aug 29 13:30:51 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b" returned: 0 in 0.546s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:51 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:51 devstack sudo[105370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056
Aug 29 13:30:51 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:52 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c 1073741824" returned: 0 in 0.420s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:52 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c
Aug 29 13:30:52 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:52 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056" returned: 0 in 0.369s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:52 devstack sudo[105381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056
Aug 29 13:30:52 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:52 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" returned: 0 in 0.256s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffad1f41-5f1a-4d63-9c2e-f4d4d9e835e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8877d15-f91a-429f-89e6-f347fa5129c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Volume volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c (4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c): created successfully
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8877d15-f91a-429f-89e6-f347fa5129c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:52 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (1c9033ef-5445-4feb-9152-9c26cab78015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b.475e9cea-2e3c-4d3b-a619-9d431f8a5056" returned: 0 in 0.277s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:52 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-2886714c-e2de-4954-ba81-2d5c13efec3e tempest-ProjectMemberTests-936537036 None] Created volume successfully.
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-5a334e0c-c482-4f52-b30d-02dc505354ac-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-475e9cea-2e3c-4d3b-a619-9d431f8a5056" released by "_delete_snapshot" :: held 1.681s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-00a53a22-927a-4238-8a71-186963a6f84b" released by "delete_snapshot" :: held 1.706s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Lock "cinder-5a334e0c-c482-4f52-b30d-02dc505354ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-734e96e2-ce5e-4625-81b6-c2e4791b266f" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-734e96e2-ce5e-4625-81b6-c2e4791b266f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-5a334e0c-c482-4f52-b30d-02dc505354ac" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-5a334e0c-c482-4f52-b30d-02dc505354ac" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Deleting offline snapshot 5a334e0c-c482-4f52-b30d-02dc505354ac of volume 734e96e2-ce5e-4625-81b6-c2e4791b266f {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] snapshot_file for this snap is: volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b180ea59-fc6a-4efb-9c26-b1af4ce76623]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Created reservations ['b754e12c-dce4-44f9-93f5-d6f1cc348122', '71c6562a-7610-4c3c-850e-67cbd387ebc7', '506f646f-6383-4e70-92e0-0c6456b77bfc', 'fb75bb76-9c36-43ae-93d1-b0cba76dbb05'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:52 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Delete snapshot completed successfully.
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-0f0368ef-81be-43c7-bf4c-1f5921790e5b tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-475e9cea-2e3c-4d3b-a619-9d431f8a5056-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:52 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac
Aug 29 13:30:52 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "cinder-00a53a22-927a-4238-8a71-186963a6f84b-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-00a53a22-927a-4238-8a71-186963a6f84b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "cinder-quobyte-00a53a22-927a-4238-8a71-186963a6f84b" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:52 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac" returned: 0 in 0.394s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-734e96e2-ce5e-4625-81b6-c2e4791b266f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:52 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-00a53a22-927a-4238-8a71-186963a6f84b" acquired by "delete_volume" :: waited 0.035s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac413359-29cd-494a-8f6f-0abac74fb597]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d26fc-8d74-455c-b636-f151d0081d15]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:53 devstack sudo[105390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f
Aug 29 13:30:53 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:53 devstack sudo[105391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b
Aug 29 13:30:53 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Creating offline snapshot 2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c of volume 4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:30:53 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b" returned: 0 in 0.401s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:53 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f" returned: 0 in 0.426s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b3fb5d-6dea-4404-92e6-3f5f8bac59c7]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:53 devstack sudo[105400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b
Aug 29 13:30:53 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:53 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac
Aug 29 13:30:53 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:53 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c
Aug 29 13:30:53 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:53 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-00a53a22-927a-4238-8a71-186963a6f84b" returned: 0 in 0.268s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-00a53a22-927a-4238-8a71-186963a6f84b" released by "delete_volume" :: held 0.728s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Created reservations ['634ec70f-aadf-4489-a8ab-57f41a198b5c', 'b00ca182-a688-4b36-b94d-3f9f0b805705', '0963c5de-6c7b-4d3f-820f-0ddc64ceb924', '6794f5fa-51fe-4f54-9cc5-8890996dc275'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:53 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac" returned: 0 in 0.378s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:53 devstack sudo[105414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:53 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:53 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" returned: 0 in 0.421s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:53 devstack sudo[105416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:53 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:53 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c 1G
Aug 29 13:30:53 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "cinder-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:54 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f.5a334e0c-c482-4f52-b30d-02dc505354ac" returned: 0 in 0.314s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:54 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.315s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-5a334e0c-c482-4f52-b30d-02dc505354ac" released by "_delete_snapshot" :: held 1.653s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "cinder-quobyte-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Deleted volume successfully.
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-734e96e2-ce5e-4625-81b6-c2e4791b266f" released by "delete_snapshot" :: held 1.696s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" acquired by "delete_volume" :: waited 0.039s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8f94247a-8c4f-46d3-b836-b17b3d940270 tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-00a53a22-927a-4238-8a71-186963a6f84b-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce237e87-4eef-4987-8aba-4a55a8e1a71c]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Created reservations ['13873030-a1b7-4a36-8685-3e20871526cc', 'c3db8f7e-d9eb-424c-a114-4910118da2cb', '3a2bd060-0675-4f0d-a951-a3abc0a48fe3', '9baaa4ad-1b02-411a-bdfb-cfd2a8a65fc6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Delete snapshot completed successfully.
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-8250ae9f-ce16-406b-b334-f0251e07d9e5 tempest-ProjectReaderTests-533450984 None] Lock "cinder-5a334e0c-c482-4f52-b30d-02dc505354ac-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:54 devstack sudo[105425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677
Aug 29 13:30:54 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:54 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c 1G" returned: 0 in 0.520s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:54 devstack sudo[105428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c
Aug 29 13:30:54 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-734e96e2-ce5e-4625-81b6-c2e4791b266f-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:54 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" returned: 0 in 0.415s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:54 devstack sudo[105437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:54 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Lock "cinder-734e96e2-ce5e-4625-81b6-c2e4791b266f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:54 devstack sudo[105438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677
Aug 29 13:30:54 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:54 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c" returned: 0 in 0.355s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:54 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c is being set with open permissions: ugo+rw
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-734e96e2-ce5e-4625-81b6-c2e4791b266f" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:54 devstack sudo[105441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c
Aug 29 13:30:54 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-734e96e2-ce5e-4625-81b6-c2e4791b266f" acquired by "delete_volume" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[037192f0-e8b9-4927-8ef1-14b5ea2adc14]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:54 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.303s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:54 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" returned: 0 in 0.295s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:54 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f
Aug 29 13:30:54 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:30:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-quobyte-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677" released by "delete_volume" :: held 0.767s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:55 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c" returned: 0 in 0.287s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Created reservations ['98df0a88-e911-44f0-889e-eb2452905d58', 'ac507f3f-1fdc-4851-b267-0cd70dd7535d', '199e4d81-61c6-4697-8f6b-b237499d0fe4', 'daf7d0f3-92b6-447c-97bc-15c9b1944a44'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:55 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.info
Aug 29 13:30:55 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:55 devstack sudo[105450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:55 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:55 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f" returned: 0 in 0.441s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:55 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f
Aug 29 13:30:55 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:55 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.info" returned: 0 in 0.332s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:55 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.info is being set with open permissions: ugo+rw
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:55 devstack sudo[105460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.info
Aug 29 13:30:55 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:55 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.334s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:55 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Deleted volume successfully.
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b130946d-0df5-4d12-8bfa-36e149b8755a tempest-SnapshotDependencyTests-1053321493 None] Lock "cinder-ad9faa9d-90c8-4a8b-aaf3-a9f63c74b677-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:55 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-734e96e2-ce5e-4625-81b6-c2e4791b266f" returned: 0 in 0.306s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-734e96e2-ce5e-4625-81b6-c2e4791b266f" released by "delete_volume" :: held 0.820s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Created reservations ['87078a33-7526-4c27-84de-a5f844aa91ac', '7f5a38e4-f776-462b-83be-4883b07de07d', '0390a7bc-33d0-4ffe-a16a-1f9e8b424ff3', '33f17bce-5e7c-4641-afca-ba5cd81aafb1'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:55 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.info" returned: 0 in 0.287s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:55 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b1f7cf0d-8d21-45dd-b7ec-f3d036f84eff tempest-ProjectMemberTests-936537036 None] Create snapshot completed successfully
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:55 devstack sudo[105464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:55 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:56 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:30:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Deleted volume successfully.
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7239dfe3-a99a-416c-88b7-77f597a7c781 tempest-ProjectReaderTests-533450984 None] Lock "cinder-734e96e2-ce5e-4625-81b6-c2e4791b266f-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (e6aef4ad-70a8-4f8c-bb1d-9fcc4e63e3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8c8144-3bd5-4a5b-bf4e-eab31f2d0e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8c8144-3bd5-4a5b-bf4e-eab31f2d0e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030488506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581da75e-bd66-4aae-9f6c-c44cdb62b209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:56Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d9a497-796a-4aab-9ceb-c52ddab1c13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d9a497-796a-4aab-9ceb-c52ddab1c13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01116700-3535-4041-9f04-88e31d9d0f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01116700-3535-4041-9f04-88e31d9d0f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '581da75e-bd66-4aae-9f6c-c44cdb62b209', 'volume_name': 'volume-581da75e-bd66-4aae-9f6c-c44cdb62b209', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8948687-93a6-4be9-a142-0e022275df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8948687-93a6-4be9-a142-0e022275df09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327bd225-921a-4dde-976c-a044b468f8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:56 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Volume 581da75e-bd66-4aae-9f6c-c44cdb62b209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-581da75e-bd66-4aae-9f6c-c44cdb62b209', 'volume_size': 1}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030488506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581da75e-bd66-4aae-9f6c-c44cdb62b209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:30:56Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Creating volume 581da75e-bd66-4aae-9f6c-c44cdb62b209 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:30:56 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:56 devstack sudo[105468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 1073741824
Aug 29 13:30:56 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Lock "cinder-2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Deleting offline snapshot 2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c of volume 4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] snapshot_file for this snap is: volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c790697d-145e-4dc5-b8c9-fecf5db82ade]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:56 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c
Aug 29 13:30:56 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:56 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 1073741824" returned: 0 in 0.479s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:57 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209
Aug 29 13:30:57 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:57 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c" returned: 0 in 0.427s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bdeb47-a09c-4f98-acab-774f57099c2a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:57 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c
Aug 29 13:30:57 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:57 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209" returned: 0 in 0.275s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327bd225-921a-4dde-976c-a044b468f8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-581da75e-bd66-4aae-9f6c-c44cdb62b209', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a20adad-748d-4d40-81ce-886fcd09b4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:30:57 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Volume volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 (581da75e-bd66-4aae-9f6c-c44cdb62b209): created successfully
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a20adad-748d-4d40-81ce-886fcd09b4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (e6aef4ad-70a8-4f8c-bb1d-9fcc4e63e3d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:30:57 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-380658bf-a39e-43dd-a283-d24e17592fbb tempest-ProjectReaderTests-533450984 None] Created volume successfully.
Aug 29 13:30:57 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" returned: 0 in 0.377s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:57 devstack sudo[105487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c
Aug 29 13:30:57 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:57 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c" returned: 0 in 0.335s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:57 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:57 devstack sudo[105492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c
Aug 29 13:30:57 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:58 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c.2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c" returned: 0 in 0.264s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c" released by "_delete_snapshot" :: held 1.507s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" released by "delete_snapshot" :: held 1.528s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Created reservations ['4d21e4eb-3302-4593-b46b-36520479ef3c', '398fe1af-329a-43a4-b4ef-3a045858385d', 'bc44f772-4f7c-46bd-9ef7-3049404e995f', 'f660caab-9245-4b0a-8cf4-8eea97a353bd'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:58 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Delete snapshot completed successfully.
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-daad3a60-d83c-4cf5-ae1a-10053ef8b35c tempest-ProjectMemberTests-936537036 None] Lock "cinder-2e9e2ce8-e496-47b3-aa8c-2cdbfed7186c-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Creating offline snapshot c9e5172a-de04-4f0e-ae01-a0ccfad249df of volume 581da75e-bd66-4aae-9f6c-c44cdb62b209 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f3cf6c-a879-4ded-8cd8-17b20eeda82e]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:58 devstack sudo[105495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209
Aug 29 13:30:58 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c784b0-c6a4-42c0-9847-04f9389b3bca]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:30:58 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:59 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c
Aug 29 13:30:59 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:59 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209" returned: 0 in 0.449s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:59 devstack sudo[105502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df 1G
Aug 29 13:30:59 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:59 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" returned: 0 in 0.415s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:59 devstack sudo[105510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c
Aug 29 13:30:59 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:59 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df 1G" returned: 0 in 0.441s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:59 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df
Aug 29 13:30:59 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:59 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" returned: 0 in 0.287s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c" released by "delete_volume" :: held 0.775s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Created reservations ['817d7b92-fb64-4116-8981-86e592ad5479', '64337c5b-d8c1-43ee-82d6-c53d24d53780', '895ae9a8-317c-436f-8a69-fecd834a2d1d', '83c3d350-7d74-48ad-83a8-1f86539229a6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:59 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:30:59 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df is being set with open permissions: ugo+rw
Aug 29 13:30:59 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:30:59 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:30:59 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:30:59 devstack sudo[105522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df
Aug 29 13:30:59 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:00 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:00 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.345s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df" returned: 0 in 0.308s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Deleted volume successfully.
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e1aecd1f-0414-4e30-9fb6-4d2db2bf07e9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-4d1ff30e-1a9e-4b3f-bbd0-4aed81d74e5c-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:00 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.info
Aug 29 13:31:00 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (9a887800-361a-4bbf-b2f5-4a26f20a9a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921ec16b-5b99-4bdf-b60c-e18fc296d808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921ec16b-5b99-4bdf-b60c-e18fc296d808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669105666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b45c0e7-8234-4484-991f-7c98d5306b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:00Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d742c462-c792-4da5-9a43-4eccb42516f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:00 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d742c462-c792-4da5-9a43-4eccb42516f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc7ac74-fa5e-40c9-a14d-d118969af065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc7ac74-fa5e-40c9-a14d-d118969af065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b45c0e7-8234-4484-991f-7c98d5306b96', 'volume_name': 'volume-9b45c0e7-8234-4484-991f-7c98d5306b96', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1b9186-c04c-43d4-b00e-baf8cf590c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1b9186-c04c-43d4-b00e-baf8cf590c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a160dcc7-b17a-45f7-bf42-f1021999242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:00 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Volume 9b45c0e7-8234-4484-991f-7c98d5306b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b45c0e7-8234-4484-991f-7c98d5306b96', 'volume_size': 1}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.info" returned: 0 in 0.351s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:00 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.info is being set with open permissions: ugo+rw
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:00 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.info
Aug 29 13:31:00 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:00 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.info" returned: 0 in 0.257s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.312s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669105666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b45c0e7-8234-4484-991f-7c98d5306b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:00Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Creating volume 9b45c0e7-8234-4484-991f-7c98d5306b96 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:31:00 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:31:00 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:00 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96 1073741824
Aug 29 13:31:00 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:00 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-528ef1fd-ab47-41ec-9a60-29c6ce94d373 tempest-ProjectReaderTests-533450984 None] Create snapshot completed successfully
Aug 29 13:31:01 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96 1073741824" returned: 0 in 0.434s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:01 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96
Aug 29 13:31:01 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:01 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a160dcc7-b17a-45f7-bf42-f1021999242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b45c0e7-8234-4484-991f-7c98d5306b96', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120668dd-c9a5-415f-a23f-badbcd731585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:01 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Volume volume-9b45c0e7-8234-4484-991f-7c98d5306b96 (9b45c0e7-8234-4484-991f-7c98d5306b96): created successfully
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120668dd-c9a5-415f-a23f-badbcd731585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (9a887800-361a-4bbf-b2f5-4a26f20a9a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:01 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-fd803058-2d9e-4b2e-ab3d-ee4ce5dc0b96 tempest-ProjectMemberTests-936537036 None] Created volume successfully.
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-c9e5172a-de04-4f0e-ae01-a0ccfad249df-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Lock "cinder-c9e5172a-de04-4f0e-ae01-a0ccfad249df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-581da75e-bd66-4aae-9f6c-c44cdb62b209" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-581da75e-bd66-4aae-9f6c-c44cdb62b209" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-c9e5172a-de04-4f0e-ae01-a0ccfad249df" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-c9e5172a-de04-4f0e-ae01-a0ccfad249df" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Deleting offline snapshot c9e5172a-de04-4f0e-ae01-a0ccfad249df of volume 581da75e-bd66-4aae-9f6c-c44cdb62b209 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] snapshot_file for this snap is: volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6d3bd9-b9a3-4237-8699-08014116f88d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:01 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:01 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df
Aug 29 13:31:01 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:02 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df" returned: 0 in 0.359s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-581da75e-bd66-4aae-9f6c-c44cdb62b209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e91312-8dd0-4975-81a6-856420c1c2a0]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:02 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209
Aug 29 13:31:02 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:02 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209" returned: 0 in 0.397s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:02 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df
Aug 29 13:31:02 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Creating offline snapshot 9552d71b-b2b9-45f1-b766-433a7ca6f1a8 of volume 9b45c0e7-8234-4484-991f-7c98d5306b96 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee42d55e-8091-42e7-aa82-29cf642d216d]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:02 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:02 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96
Aug 29 13:31:02 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:03 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df" returned: 0 in 0.374s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:03 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df
Aug 29 13:31:03 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:03 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96" returned: 0 in 0.372s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:03 devstack sudo[105564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 1G
Aug 29 13:31:03 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:03 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209.c9e5172a-de04-4f0e-ae01-a0ccfad249df" returned: 0 in 0.294s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-c9e5172a-de04-4f0e-ae01-a0ccfad249df" released by "_delete_snapshot" :: held 1.557s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-581da75e-bd66-4aae-9f6c-c44cdb62b209" released by "delete_snapshot" :: held 1.582s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Created reservations ['51611b3e-c2a3-4329-bf11-b1df1f308854', '61484996-9939-4f93-b91b-f6b0978db179', 'ee41c713-1a84-45bb-b64a-4dd378cb4885', 'ac539cc2-1fd7-442e-ba14-862d73f645d0'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:03 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Delete snapshot completed successfully.
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-db0d2929-7d5c-43c5-af39-c555d46e727e tempest-ProjectReaderTests-533450984 None] Lock "cinder-c9e5172a-de04-4f0e-ae01-a0ccfad249df-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:03 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 1G" returned: 0 in 0.493s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b45c0e7-8234-4484-991f-7c98d5306b96 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:03 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b45c0e7-8234-4484-991f-7c98d5306b96 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8
Aug 29 13:31:03 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-581da75e-bd66-4aae-9f6c-c44cdb62b209-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Lock "cinder-581da75e-bd66-4aae-9f6c-c44cdb62b209-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:03 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b45c0e7-8234-4484-991f-7c98d5306b96 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8" returned: 0 in 0.345s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:03 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 is being set with open permissions: ugo+rw
Aug 29 13:31:03 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:04 devstack sudo[105578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8
Aug 29 13:31:04 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-581da75e-bd66-4aae-9f6c-c44cdb62b209" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-581da75e-bd66-4aae-9f6c-c44cdb62b209" acquired by "delete_volume" :: waited 0.027s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[9462c39f-f8b2-470e-baac-393807abe0a6]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:04 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209
Aug 29 13:31:04 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:04 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8" returned: 0 in 0.304s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:04 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.info
Aug 29 13:31:04 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:04 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209" returned: 0 in 0.468s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:04 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.info" returned: 0 in 0.292s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:04 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.info is being set with open permissions: ugo+rw
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:04 devstack sudo[105590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209
Aug 29 13:31:04 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:04 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.info
Aug 29 13:31:04 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:04 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-581da75e-bd66-4aae-9f6c-c44cdb62b209" returned: 0 in 0.269s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-581da75e-bd66-4aae-9f6c-c44cdb62b209" released by "delete_volume" :: held 0.824s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:04 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.info" returned: 0 in 0.280s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:04 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-38227718-4a44-4864-9b45-6a6e67be33d9 tempest-ProjectMemberTests-936537036 None] Create snapshot completed successfully
Aug 29 13:31:04 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Created reservations ['5ee16c43-ef2e-46b4-8717-10946eab0d9c', '89fbd418-36f6-4008-84e5-085327d0f75d', 'ce003aa1-7389-4f7c-94cf-1fadd175fda5', '8970b2b7-e7d0-4a08-84e4-cc1927b61b09'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:05 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:05 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:05 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.299s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:05 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Deleted volume successfully.
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-be816d9a-4638-467d-b7c9-51aa57959d8f tempest-ProjectReaderTests-533450984 None] Lock "cinder-581da75e-bd66-4aae-9f6c-c44cdb62b209-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (c2e2adcd-1477-4ed9-994c-3c3d432b6cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0ca020-84ab-4c3f-b015-ca85f797cb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0ca020-84ab-4c3f-b015-ca85f797cb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985917253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d49f86-8ab8-4826-9456-82537942c0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:06Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a026a60-a69f-4bc7-b50c-edfab9cfd9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a026a60-a69f-4bc7-b50c-edfab9cfd9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bf8d4e-f6aa-491f-b942-5a65369de3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bf8d4e-f6aa-491f-b942-5a65369de3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d49f86-8ab8-4826-9456-82537942c0f7', 'volume_name': 'volume-55d49f86-8ab8-4826-9456-82537942c0f7', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f762bb0a-8ef8-456b-9950-9a38acb87c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f762bb0a-8ef8-456b-9950-9a38acb87c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e9eca1-b530-4f05-ac86-7c1fbdd5922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:05 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Volume 55d49f86-8ab8-4826-9456-82537942c0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d49f86-8ab8-4826-9456-82537942c0f7', 'volume_size': 1}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985917253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d49f86-8ab8-4826-9456-82537942c0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:06Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Creating volume 55d49f86-8ab8-4826-9456-82537942c0f7 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:31:05 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:05 devstack sudo[105599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7 1073741824
Aug 29 13:31:05 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-9552d71b-b2b9-45f1-b766-433a7ca6f1a8-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Lock "cinder-9552d71b-b2b9-45f1-b766-433a7ca6f1a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-9b45c0e7-8234-4484-991f-7c98d5306b96" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-9b45c0e7-8234-4484-991f-7c98d5306b96" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:05 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-9552d71b-b2b9-45f1-b766-433a7ca6f1a8" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-9552d71b-b2b9-45f1-b766-433a7ca6f1a8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Deleting offline snapshot 9552d71b-b2b9-45f1-b766-433a7ca6f1a8 of volume 9b45c0e7-8234-4484-991f-7c98d5306b96 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] snapshot_file for this snap is: volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e466598-792e-4031-9e0a-3d55ed6388f7]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:06 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8
Aug 29 13:31:06 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:06 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7 1073741824" returned: 0 in 0.533s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:06 devstack sudo[105607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7
Aug 29 13:31:06 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:06 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8" returned: 0 in 0.394s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b45c0e7-8234-4484-991f-7c98d5306b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a31d82d-55ba-49d7-b894-3b926b7a5e52]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:06 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:06 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:06 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e9eca1-b530-4f05-ac86-7c1fbdd5922c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d49f86-8ab8-4826-9456-82537942c0f7', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fdb58d-8cd4-4527-8838-aa58e725a3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:06 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Volume volume-55d49f86-8ab8-4826-9456-82537942c0f7 (55d49f86-8ab8-4826-9456-82537942c0f7): created successfully
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fdb58d-8cd4-4527-8838-aa58e725a3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (c2e2adcd-1477-4ed9-994c-3c3d432b6cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:06 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-0c60ed0c-8bf2-499d-9658-02c44192c905 tempest-ProjectReaderTests-533450984 None] Created volume successfully.
Aug 29 13:31:06 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96" returned: 0 in 0.352s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:06 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:06 devstack sudo[105619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8
Aug 29 13:31:06 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:07 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:07 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8
Aug 29 13:31:07 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:07 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96.9552d71b-b2b9-45f1-b766-433a7ca6f1a8" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-9552d71b-b2b9-45f1-b766-433a7ca6f1a8" released by "_delete_snapshot" :: held 1.414s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-9b45c0e7-8234-4484-991f-7c98d5306b96" released by "delete_snapshot" :: held 1.440s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Created reservations ['990a7ef4-32e5-4bc5-bad1-69ce4d6e8dec', '0f751727-66f3-4999-a943-a8f0eec2815d', '5bd3199c-4398-4fef-bfee-0d5e9835a24f', '01be8e20-efa0-44bb-a664-dd4a6d888376'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:07 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Delete snapshot completed successfully.
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-76b0c917-40ed-483b-a95b-a829bee62aae tempest-ProjectMemberTests-936537036 None] Lock "cinder-9552d71b-b2b9-45f1-b766-433a7ca6f1a8-delete_snapshot" released by "delete_snapshot" :: held 1.563s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Creating offline snapshot f5c652ea-de03-4565-8642-42d576ffc2d0 of volume 55d49f86-8ab8-4826-9456-82537942c0f7 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e5edcd-d91b-48c8-9807-61aec7757e47]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:07 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:07 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7
Aug 29 13:31:07 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-9b45c0e7-8234-4484-991f-7c98d5306b96-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Lock "cinder-9b45c0e7-8234-4484-991f-7c98d5306b96-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-9b45c0e7-8234-4484-991f-7c98d5306b96" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-9b45c0e7-8234-4484-991f-7c98d5306b96" acquired by "delete_volume" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b38755-f152-4dde-a81e-3290ea5fb010]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:08 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7" returned: 0 in 0.376s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:08 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 1G
Aug 29 13:31:08 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:08 devstack sudo[105632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96
Aug 29 13:31:08 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:08 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96" returned: 0 in 0.371s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:08 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96
Aug 29 13:31:08 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:08 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 1G" returned: 0 in 0.388s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d49f86-8ab8-4826-9456-82537942c0f7 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:08 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d49f86-8ab8-4826-9456-82537942c0f7 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0
Aug 29 13:31:08 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:08 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-9b45c0e7-8234-4484-991f-7c98d5306b96" returned: 0 in 0.250s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-9b45c0e7-8234-4484-991f-7c98d5306b96" released by "delete_volume" :: held 0.680s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Created reservations ['528a4f29-723f-4ee9-8998-ba3872746dd4', '6ea28e75-d1d5-41a9-b642-cfb5a54c47f8', '5ba7e8f5-a951-4b4c-91ba-20cc4f7ae629', 'e3353e7f-b688-4eb8-a945-c73e705042dd'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:08 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d49f86-8ab8-4826-9456-82537942c0f7 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0" returned: 0 in 0.304s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:08 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 is being set with open permissions: ugo+rw
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:08 devstack sudo[105651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0
Aug 29 13:31:08 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:08 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:09 devstack sudo[105653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:09 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:09 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:09 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.267s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Deleted volume successfully.
Aug 29 13:31:09 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.info
Aug 29 13:31:09 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-96d95ff5-4b61-4256-9609-927d153cb843 tempest-ProjectMemberTests-936537036 None] Lock "cinder-9b45c0e7-8234-4484-991f-7c98d5306b96-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:09 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.info" returned: 0 in 0.257s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:09 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.info is being set with open permissions: ugo+rw
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:09 devstack sudo[105660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.info
Aug 29 13:31:09 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:09 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (3672690d-2591-4f25-86e5-22a29b10774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e753e7e3-5127-4d14-acd6-0c757b52b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.info" returned: 0 in 0.281s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e753e7e3-5127-4d14-acd6-0c757b52b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339809372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ed2c91-267a-4303-98b8-a637a319d221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:10Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fe54d5-c266-490e-aeb7-49f015ffcf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fe54d5-c266-490e-aeb7-49f015ffcf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b909c24-8969-4396-bf9b-370d98fa1e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b909c24-8969-4396-bf9b-370d98fa1e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ed2c91-267a-4303-98b8-a637a319d221', 'volume_name': 'volume-e9ed2c91-267a-4303-98b8-a637a319d221', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b6a51e-4f31-45cf-8445-b657c258e17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b6a51e-4f31-45cf-8445-b657c258e17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd146e77-62dc-4a83-b309-b61f61384e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:09 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Volume e9ed2c91-267a-4303-98b8-a637a319d221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ed2c91-267a-4303-98b8-a637a319d221', 'volume_size': 1}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339809372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ed2c91-267a-4303-98b8-a637a319d221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:10Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Creating volume e9ed2c91-267a-4303-98b8-a637a319d221 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:31:09 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:31:09 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:09 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221 1073741824
Aug 29 13:31:09 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:09 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-531f9a8e-69e4-4e24-b0b6-985cdd8b9412 tempest-ProjectReaderTests-533450984 None] Create snapshot completed successfully
Aug 29 13:31:10 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221 1073741824" returned: 0 in 0.418s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:10 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221
Aug 29 13:31:10 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:10 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd146e77-62dc-4a83-b309-b61f61384e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ed2c91-267a-4303-98b8-a637a319d221', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb778fd-2333-4630-bd05-5467eaf3e0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:10 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Volume volume-e9ed2c91-267a-4303-98b8-a637a319d221 (e9ed2c91-267a-4303-98b8-a637a319d221): created successfully
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb778fd-2333-4630-bd05-5467eaf3e0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (3672690d-2591-4f25-86e5-22a29b10774d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:10 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f91a4924-ce27-4aec-a13e-6ad18ab9f581 tempest-ProjectMemberTests-936537036 None] Created volume successfully.
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Creating offline snapshot 4c4e503f-8d65-456e-b75f-e1016f1ba303 of volume e9ed2c91-267a-4303-98b8-a637a319d221 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa56ee8d-b5dc-497c-b1f4-efd845772432]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:10 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-f5c652ea-de03-4565-8642-42d576ffc2d0-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Lock "cinder-f5c652ea-de03-4565-8642-42d576ffc2d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:11 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-55d49f86-8ab8-4826-9456-82537942c0f7" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:11 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-55d49f86-8ab8-4826-9456-82537942c0f7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-f5c652ea-de03-4565-8642-42d576ffc2d0" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f5c652ea-de03-4565-8642-42d576ffc2d0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Deleting offline snapshot f5c652ea-de03-4565-8642-42d576ffc2d0 of volume 55d49f86-8ab8-4826-9456-82537942c0f7 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] snapshot_file for this snap is: volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeac6a3-6b2c-4680-bb35-6c5c5af72fd4]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:11 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0
Aug 29 13:31:11 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:11 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221" returned: 0 in 0.383s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:11 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 1G
Aug 29 13:31:11 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:11 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0" returned: 0 in 0.366s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55d49f86-8ab8-4826-9456-82537942c0f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c9a37f-1f5b-4eed-ba91-49c5c9789e3b]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:11 devstack sudo[105683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7
Aug 29 13:31:11 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:11 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 1G" returned: 0 in 0.401s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9ed2c91-267a-4303-98b8-a637a319d221 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:11 devstack sudo[105689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9ed2c91-267a-4303-98b8-a637a319d221 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303
Aug 29 13:31:11 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:11 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7" returned: 0 in 0.392s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:11 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:11 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0
Aug 29 13:31:11 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:12 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9ed2c91-267a-4303-98b8-a637a319d221 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303" returned: 0 in 0.311s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:12 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 is being set with open permissions: ugo+rw
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:12 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303
Aug 29 13:31:12 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:12 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0" returned: 0 in 0.360s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:12 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:12 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0
Aug 29 13:31:12 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:12 devstack sudo[105708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.info
Aug 29 13:31:12 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:12 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7.f5c652ea-de03-4565-8642-42d576ffc2d0" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f5c652ea-de03-4565-8642-42d576ffc2d0" released by "_delete_snapshot" :: held 1.462s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-55d49f86-8ab8-4826-9456-82537942c0f7" released by "delete_snapshot" :: held 1.483s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:12 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.info" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:12 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.info is being set with open permissions: ugo+rw
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:12 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.info
Aug 29 13:31:12 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Created reservations ['89078893-5084-42e0-b2f6-20b4c35784ea', '71962b23-ba25-4075-b5b3-e12769132287', 'c135b95c-4265-4271-a436-618b1afd1330', '965fbf8e-2558-48e3-92ec-638326f8c8e6'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Delete snapshot completed successfully.
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e69b9416-9312-4ffd-a2aa-66a5af153b31 tempest-ProjectReaderTests-533450984 None] Lock "cinder-f5c652ea-de03-4565-8642-42d576ffc2d0-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:12 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.info" returned: 0 in 0.248s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:12 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:12 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-a91864e1-8290-412a-aabc-761b606f9122 tempest-ProjectMemberTests-936537036 None] Create snapshot completed successfully
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-4c4e503f-8d65-456e-b75f-e1016f1ba303-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-4c4e503f-8d65-456e-b75f-e1016f1ba303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-e9ed2c91-267a-4303-98b8-a637a319d221" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-e9ed2c91-267a-4303-98b8-a637a319d221" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-4c4e503f-8d65-456e-b75f-e1016f1ba303" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-4c4e503f-8d65-456e-b75f-e1016f1ba303" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Deleting offline snapshot 4c4e503f-8d65-456e-b75f-e1016f1ba303 of volume e9ed2c91-267a-4303-98b8-a637a319d221 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] snapshot_file for this snap is: volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1c4039-453b-4203-8783-14337fbdbf17]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-55d49f86-8ab8-4826-9456-82537942c0f7-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Lock "cinder-55d49f86-8ab8-4826-9456-82537942c0f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:13 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303
Aug 29 13:31:13 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-55d49f86-8ab8-4826-9456-82537942c0f7" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-55d49f86-8ab8-4826-9456-82537942c0f7" acquired by "delete_volume" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdefde0e-2501-4fd1-92a5-efd0e716a082]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:13 devstack sudo[105717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7
Aug 29 13:31:13 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:13 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303" returned: 0 in 0.386s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9ed2c91-267a-4303-98b8-a637a319d221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ebb66f-8f3e-4d0e-a935-f93a689e1c78]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:13 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221
Aug 29 13:31:13 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:13 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7" returned: 0 in 0.368s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:13 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7
Aug 29 13:31:13 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:13 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221" returned: 0 in 0.367s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:13 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303
Aug 29 13:31:13 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:13 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-55d49f86-8ab8-4826-9456-82537942c0f7" returned: 0 in 0.253s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-55d49f86-8ab8-4826-9456-82537942c0f7" released by "delete_volume" :: held 0.681s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:13 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Created reservations ['4ca7b4c0-a05b-45ae-978e-a9336db21160', '1382e6d7-d17e-49b8-8d61-4cd1e5405cc4', '80095f13-f223-48ab-8bc3-b1b792323a87', '99d90f1b-b789-4124-894f-3c4816275084'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:14 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:14 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:14 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303" returned: 0 in 0.370s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:14 devstack sudo[105742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303
Aug 29 13:31:14 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:14 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.273s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:14 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Deleted volume successfully.
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1b833343-502e-403e-ba2f-270433f7f07b tempest-ProjectReaderTests-533450984 None] Lock "cinder-55d49f86-8ab8-4826-9456-82537942c0f7-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:14 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221.4c4e503f-8d65-456e-b75f-e1016f1ba303" returned: 0 in 0.265s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-4c4e503f-8d65-456e-b75f-e1016f1ba303" released by "_delete_snapshot" :: held 1.483s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-e9ed2c91-267a-4303-98b8-a637a319d221" released by "delete_snapshot" :: held 1.507s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Created reservations ['0a00685d-09ac-4376-9d08-1bebf84543bd', 'e6f240c1-3e1c-4a9e-b686-d7406cc36d02', '016aaac7-5ba2-4e6b-9c5a-abbb8d8f0f9e', '9ccd2960-20c6-4035-8e94-ca81ffc4d2d5'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:14 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Delete snapshot completed successfully.
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-6f2a74dd-0cf1-4800-84df-2cf6e7f255f9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-4c4e503f-8d65-456e-b75f-e1016f1ba303-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (493bb4e0-120e-4319-a75f-32b4f807792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a2dffe-6d75-4a4d-9c22-103c4783a17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a2dffe-6d75-4a4d-9c22-103c4783a17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221665316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74d56b2-967a-497e-af4e-d2a2d40aa12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:15Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598f2172-2530-4f93-b5df-a9811955b6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598f2172-2530-4f93-b5df-a9811955b6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8c4992-919d-463d-8e77-a5213d71fac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8c4992-919d-463d-8e77-a5213d71fac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74d56b2-967a-497e-af4e-d2a2d40aa12e', 'volume_name': 'volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea27af5-215e-4a39-8ccb-f192247470d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea27af5-215e-4a39-8ccb-f192247470d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4569502-f441-43fd-82c6-92ceb50e340f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:14 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Volume f74d56b2-967a-497e-af4e-d2a2d40aa12e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e', 'volume_size': 1}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221665316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74d56b2-967a-497e-af4e-d2a2d40aa12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdce77279c4eb59cbbe9deda7fa255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:15Z,use_quota=True,user_id='2f3faedb119e4b2e9aa3baa9b239847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Creating volume f74d56b2-967a-497e-af4e-d2a2d40aa12e {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:31:14 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:31:14 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:14 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e 1073741824
Aug 29 13:31:14 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-e9ed2c91-267a-4303-98b8-a637a319d221-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Lock "cinder-e9ed2c91-267a-4303-98b8-a637a319d221-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-e9ed2c91-267a-4303-98b8-a637a319d221" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-e9ed2c91-267a-4303-98b8-a637a319d221" acquired by "delete_volume" :: waited 0.022s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[290616c8-11aa-4086-b880-7aa8eeb7dcdd]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:15 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e 1073741824" returned: 0 in 0.461s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:15 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e
Aug 29 13:31:15 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:15 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221
Aug 29 13:31:15 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:15 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e" returned: 0 in 0.250s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4569502-f441-43fd-82c6-92ceb50e340f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1892d5-6964-4a7c-93fb-d357509bfe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:15 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Volume volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e (f74d56b2-967a-497e-af4e-d2a2d40aa12e): created successfully
Aug 29 13:31:15 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1892d5-6964-4a7c-93fb-d357509bfe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Flow 'volume_create_manager' (493bb4e0-120e-4319-a75f-32b4f807792c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221" returned: 0 in 0.392s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:15 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-f7712ccb-e9cf-4be7-a541-28e8eb9840a5 tempest-ProjectReaderTests-533450984 None] Created volume successfully.
Aug 29 13:31:15 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221
Aug 29 13:31:15 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:15 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-e9ed2c91-267a-4303-98b8-a637a319d221" returned: 0 in 0.271s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:15 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-e9ed2c91-267a-4303-98b8-a637a319d221" released by "delete_volume" :: held 0.723s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Creating offline snapshot c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 of volume f74d56b2-967a-497e-af4e-d2a2d40aa12e {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b3885a-5058-4df3-adb4-2b2599d194cc]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Created reservations ['fd09279c-0c6d-4796-8fb4-04de0da4d5c6', '1ce60aa6-953c-4a88-9d07-e87de9deeed4', 'fd914972-4051-45ad-97d4-62ea2d64a9b7', '50fa8573-2b27-4139-a06d-fb40b0ef238c'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:16 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e
Aug 29 13:31:16 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:16 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:16 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:16 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.270s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:16 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Deleted volume successfully.
Aug 29 13:31:16 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1609ebe3-1d10-4e7f-9afb-b589747a7810 tempest-ProjectMemberTests-936537036 None] Lock "cinder-e9ed2c91-267a-4303-98b8-a637a319d221-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e" returned: 0 in 0.432s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:16 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 1G
Aug 29 13:31:16 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:31:16 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (5cdec02e-3289-4f0a-a63f-6816b1561157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11dd8079-2aa2-4783-aedf-6eb4eda39a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 1G" returned: 0 in 0.445s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11dd8079-2aa2-4783-aedf-6eb4eda39a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-897758854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81c6eb8-1a58-474a-a052-776bb1ef9b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:17Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:16 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6
Aug 29 13:31:16 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed45606-9ab0-42d9-9346-cacee28d2977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed45606-9ab0-42d9-9346-cacee28d2977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ab53b8-e8fb-4fe9-955f-aaa6a9519d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ab53b8-e8fb-4fe9-955f-aaa6a9519d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81c6eb8-1a58-474a-a052-776bb1ef9b12', 'volume_name': 'volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c911f99e-1d16-4152-b72d-7da4cc595750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c911f99e-1d16-4152-b72d-7da4cc595750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71877896-66f6-46b4-b685-5b998fe335bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:16 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Volume b81c6eb8-1a58-474a-a052-776bb1ef9b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12', 'volume_size': 1}
Aug 29 13:31:16 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:17 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6" returned: 0 in 0.290s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:17 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 is being set with open permissions: ugo+rw
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:17 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6
Aug 29 13:31:17 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:17 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6" returned: 0 in 0.243s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:17 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.info
Aug 29 13:31:17 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:17 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.info" returned: 0 in 0.239s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:17 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.info is being set with open permissions: ugo+rw
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:17 devstack sudo[105788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.info
Aug 29 13:31:17 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:17 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.info" returned: 0 in 0.247s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-897758854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81c6eb8-1a58-474a-a052-776bb1ef9b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:17Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Creating volume b81c6eb8-1a58-474a-a052-776bb1ef9b12 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:31:17 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:31:17 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:18 devstack sudo[105791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 1073741824
Aug 29 13:31:18 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-101071a2-b9bf-4028-98be-bd048b3efbf5 tempest-ProjectReaderTests-533450984 None] Create snapshot completed successfully
Aug 29 13:31:18 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 1073741824" returned: 0 in 0.398s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:18 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12
Aug 29 13:31:18 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:18 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12" returned: 0 in 0.239s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:18 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:31:18 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71877896-66f6-46b4-b685-5b998fe335bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e30ae69-a6da-4b03-a0d3-75af9fe7be8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:18 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Volume volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 (b81c6eb8-1a58-474a-a052-776bb1ef9b12): created successfully
Aug 29 13:31:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e30ae69-a6da-4b03-a0d3-75af9fe7be8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:18 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (5cdec02e-3289-4f0a-a63f-6816b1561157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:18 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b7a17910-c951-4e6e-b31f-f5e94ebe8df4 tempest-ProjectMemberTests-936537036 None] Created volume successfully.
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Creating offline snapshot c9801d15-f928-45cc-9d64-8d30962ae8a1 of volume b81c6eb8-1a58-474a-a052-776bb1ef9b12 {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78a15a1-eaa7-48b8-9702-63f916c5c225]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Lock "cinder-c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-f74d56b2-967a-497e-af4e-d2a2d40aa12e" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f74d56b2-967a-497e-af4e-d2a2d40aa12e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Deleting offline snapshot c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 of volume f74d56b2-967a-497e-af4e-d2a2d40aa12e {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:31:19 devstack sudo[105799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12
Aug 29 13:31:19 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] snapshot_file for this snap is: volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab7c6b4-add4-47ba-a53a-e44b4cce0407]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:19 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6
Aug 29 13:31:19 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:19 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12" returned: 0 in 0.383s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:19 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 1G
Aug 29 13:31:19 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:19 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6" returned: 0 in 0.368s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f896211a-03ce-4149-91f6-5a02eb54fb58]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:19 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e
Aug 29 13:31:19 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:19 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 1G" returned: 0 in 0.379s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:19 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:19 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1
Aug 29 13:31:19 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:20 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e" returned: 0 in 0.380s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:20 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6
Aug 29 13:31:20 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:20 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1" returned: 0 in 0.293s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:20 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 is being set with open permissions: ugo+rw
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:20 devstack sudo[105827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1
Aug 29 13:31:20 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:20 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6" returned: 0 in 0.349s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:20 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:20 devstack sudo[105833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6
Aug 29 13:31:20 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1" returned: 0 in 0.256s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=171,cinder:UPDATE=213,cinder:INSERT=64,cinder:DELETE=17 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=176,cinder:UPDATE=216,cinder:INSERT=53,cinder:DELETE=20 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:20 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.info
Aug 29 13:31:20 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:20 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e.c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6" returned: 0 in 0.245s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6" released by "_delete_snapshot" :: held 1.436s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f74d56b2-967a-497e-af4e-d2a2d40aa12e" released by "delete_snapshot" :: held 1.464s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:20 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.info" returned: 0 in 0.266s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:20 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.info is being set with open permissions: ugo+rw
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:20 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.info
Aug 29 13:31:20 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Created reservations ['7e5c3bca-2450-4169-ab8b-4d3410c5e690', 'a7ca2cfa-fbdf-4852-bfc6-689a89cf67b5', 'ae87731a-3936-4e8c-a0df-f9ab6dfc12ee', 'f8c9e1e7-6e59-4012-a133-ee2854dcf779'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:20 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Delete snapshot completed successfully.
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-ad209f9a-eb48-4562-b505-63803dbcd774 tempest-ProjectReaderTests-533450984 None] Lock "cinder-c4cb2c4a-de46-4ddc-baa5-4a4c04ec71e6-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:20 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.info" returned: 0 in 0.245s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:20 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:20 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-5eeed9f3-3b44-4e77-9c44-69f641527f7f tempest-ProjectMemberTests-936537036 None] Create snapshot completed successfully
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-c9801d15-f928-45cc-9d64-8d30962ae8a1-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-c9801d15-f928-45cc-9d64-8d30962ae8a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-b81c6eb8-1a58-474a-a052-776bb1ef9b12" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-b81c6eb8-1a58-474a-a052-776bb1ef9b12" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-c9801d15-f928-45cc-9d64-8d30962ae8a1" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-c9801d15-f928-45cc-9d64-8d30962ae8a1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Deleting offline snapshot c9801d15-f928-45cc-9d64-8d30962ae8a1 of volume b81c6eb8-1a58-474a-a052-776bb1ef9b12 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] snapshot_file for this snap is: volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04779ae-5860-4ca1-aeb6-f1537e9146c2]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-f74d56b2-967a-497e-af4e-d2a2d40aa12e-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Lock "cinder-f74d56b2-967a-497e-af4e-d2a2d40aa12e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Acquiring lock "cinder-quobyte-f74d56b2-967a-497e-af4e-d2a2d40aa12e" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f74d56b2-967a-497e-af4e-d2a2d40aa12e" acquired by "delete_volume" :: waited 0.015s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:21 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1
Aug 29 13:31:21 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a236dfbc-5c01-42a5-86f1-d9252a78dc20]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:21 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e
Aug 29 13:31:21 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:21 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1" returned: 0 in 0.373s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd9ccdd-7d7c-4a31-a32e-0c8f8231bd84]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:21 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12
Aug 29 13:31:21 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:21 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e" returned: 0 in 0.371s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:21 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:21 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e
Aug 29 13:31:21 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:22 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12" returned: 0 in 0.349s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:22 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-f74d56b2-967a-497e-af4e-d2a2d40aa12e" returned: 0 in 0.249s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:22 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1
Aug 29 13:31:22 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Lock "cinder-quobyte-f74d56b2-967a-497e-af4e-d2a2d40aa12e" released by "delete_volume" :: held 0.681s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Created reservations ['6a52a535-0ad5-43ef-8333-3bea3dba4af1', '8ba99a08-6ada-45ab-8412-c7c012524d83', '73b0c057-1658-441a-82b2-09a2507b9e00', '02f806f6-fa8a-454f-a29f-e2534b132d71'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:22 devstack sudo[105864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:22 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:22 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1" returned: 0 in 0.330s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:22 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1
Aug 29 13:31:22 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:22 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.287s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Deleted volume successfully.
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-4d421148-0b0b-4722-8cd2-aaeb6dc5fe6d tempest-ProjectReaderTests-533450984 None] Lock "cinder-f74d56b2-967a-497e-af4e-d2a2d40aa12e-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:22 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12.c9801d15-f928-45cc-9d64-8d30962ae8a1" returned: 0 in 0.260s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-c9801d15-f928-45cc-9d64-8d30962ae8a1" released by "_delete_snapshot" :: held 1.408s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-b81c6eb8-1a58-474a-a052-776bb1ef9b12" released by "delete_snapshot" :: held 1.438s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Created reservations ['192cf611-87ac-4477-8256-c1a6c3aae734', 'a8308d86-0a24-4f58-9c19-f40fdb7412bf', 'd05d63ca-ba63-4f2e-be18-75339ed723fd', '74fd59d0-9bae-46ac-b56a-3952c3893f09'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:22 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Delete snapshot completed successfully.
Aug 29 13:31:22 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-b7cf5b0d-2e89-4e1e-b372-94d9c3527fd9 tempest-ProjectMemberTests-936537036 None] Lock "cinder-c9801d15-f928-45cc-9d64-8d30962ae8a1-delete_snapshot" released by "delete_snapshot" :: held 1.586s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-b81c6eb8-1a58-474a-a052-776bb1ef9b12-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Lock "cinder-b81c6eb8-1a58-474a-a052-776bb1ef9b12-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-b81c6eb8-1a58-474a-a052-776bb1ef9b12" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:23 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-b81c6eb8-1a58-474a-a052-776bb1ef9b12" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:23 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[80310e9d-a67f-408d-a1af-2979b22d403a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:23 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12
Aug 29 13:31:23 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:23 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12" returned: 0 in 0.404s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:23 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:23 devstack sudo[105880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12
Aug 29 13:31:23 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:24 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-b81c6eb8-1a58-474a-a052-776bb1ef9b12" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-b81c6eb8-1a58-474a-a052-776bb1ef9b12" released by "delete_volume" :: held 0.728s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Created reservations ['1aecc5e5-bbc4-45c7-93d9-924d6e43dc4c', '1a1d649d-3746-4d34-9759-8c54d17da49f', '8d549080-11a3-4a51-b2ee-6524707f4f76', 'f97d9d52-b580-4acf-8be9-3c0ef09b0d3b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:24 devstack sudo[105883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:24 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:24 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.262s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:24 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Deleted volume successfully.
Aug 29 13:31:24 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-75ff1f88-ef33-4b1f-831e-4cea59594087 tempest-ProjectMemberTests-936537036 None] Lock "cinder-b81c6eb8-1a58-474a-a052-776bb1ef9b12-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (2480bd21-e69a-4195-b4c8-a93936ad7791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24c4211-880c-4ad6-8dcd-d09547d9c220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24c4211-880c-4ad6-8dcd-d09547d9c220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748634521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268b49c9-8524-42f4-b3aa-2c07d8e83e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:25Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24aa6161-721a-4269-8744-712674746815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24aa6161-721a-4269-8744-712674746815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ba247f-68f4-46c7-8b42-6b8fd4cf3655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ba247f-68f4-46c7-8b42-6b8fd4cf3655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '268b49c9-8524-42f4-b3aa-2c07d8e83e2b', 'volume_name': 'volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981eee5a-0c55-4d8a-81b5-651104c508ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981eee5a-0c55-4d8a-81b5-651104c508ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bc249d-f248-46ba-910d-51c73e56f7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:25 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Volume 268b49c9-8524-42f4-b3aa-2c07d8e83e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b', 'volume_size': 1}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748634521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268b49c9-8524-42f4-b3aa-2c07d8e83e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:25Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Creating volume 268b49c9-8524-42f4-b3aa-2c07d8e83e2b {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:31:25 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:25 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b 1073741824
Aug 29 13:31:25 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:25 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b 1073741824" returned: 0 in 0.493s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:25 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b
Aug 29 13:31:25 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:25 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" returned: 0 in 0.259s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bc249d-f248-46ba-910d-51c73e56f7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250e8000-ff22-4e9c-8b10-06cac95f0dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:25 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Volume volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b (268b49c9-8524-42f4-b3aa-2c07d8e83e2b): created successfully
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250e8000-ff22-4e9c-8b10-06cac95f0dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:25 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (2480bd21-e69a-4195-b4c8-a93936ad7791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:25 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1b3c4517-2583-4449-801b-730af577731b tempest-ProjectMemberTests-936537036 None] Created volume successfully.
Aug 29 13:31:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:27 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Creating offline snapshot c75945f1-1719-4fae-867d-54fb6d895ad1 of volume 268b49c9-8524-42f4-b3aa-2c07d8e83e2b {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:31:27 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[2486af8e-799b-41a6-b839-dcc96addd430]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:27 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b
Aug 29 13:31:27 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:27 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" returned: 0 in 0.372s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:27 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:27 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 1G
Aug 29 13:31:27 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:28 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 1G" returned: 0 in 0.400s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:28 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1
Aug 29 13:31:28 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:28 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1" returned: 0 in 0.319s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:28 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 is being set with open permissions: ugo+rw
Aug 29 13:31:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:28 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1
Aug 29 13:31:28 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:28 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1" returned: 0 in 0.247s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:28 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.info
Aug 29 13:31:28 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:28 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.info" returned: 0 in 0.304s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:28 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.info is being set with open permissions: ugo+rw
Aug 29 13:31:28 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:28 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.info
Aug 29 13:31:28 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:29 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.info" returned: 0 in 0.279s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:29 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:29 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-da6df90c-d342-4e1f-ac16-412776570637 tempest-ProjectMemberTests-936537036 None] Create snapshot completed successfully
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-c75945f1-1719-4fae-867d-54fb6d895ad1-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Lock "cinder-c75945f1-1719-4fae-867d-54fb6d895ad1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-c75945f1-1719-4fae-867d-54fb6d895ad1" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-c75945f1-1719-4fae-867d-54fb6d895ad1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Deleting offline snapshot c75945f1-1719-4fae-867d-54fb6d895ad1 of volume 268b49c9-8524-42f4-b3aa-2c07d8e83e2b {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] snapshot_file for this snap is: volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c1d18-9524-4f6b-aaaa-a379e5d7839a]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:30 devstack sudo[105958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1
Aug 29 13:31:30 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:30 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1" returned: 0 in 0.379s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08c4e62-8954-4fca-b664-8f4b3be81387]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:30 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:31 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b
Aug 29 13:31:31 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:31 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" returned: 0 in 0.367s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:31 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1
Aug 29 13:31:31 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:31 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1" returned: 0 in 0.348s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:31 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1
Aug 29 13:31:31 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:31 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:31 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b.c75945f1-1719-4fae-867d-54fb6d895ad1" returned: 0 in 0.246s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-c75945f1-1719-4fae-867d-54fb6d895ad1" released by "_delete_snapshot" :: held 1.435s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:31 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" released by "delete_snapshot" :: held 1.463s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:32 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Created reservations ['b4ad3506-7ea0-49cb-baa7-16ff4db2d4f0', '467323a9-bd27-4a9a-a7a4-b8ba2e7431b7', '53327495-8fa8-4ad5-b736-c98c1316e3ec', '1d62c741-5676-4691-b9db-2779b8a1072b'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:32 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Delete snapshot completed successfully.
Aug 29 13:31:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-1d7c6867-f31a-4d5a-9f7b-9e785e0d53e8 tempest-ProjectMemberTests-936537036 None] Lock "cinder-c75945f1-1719-4fae-867d-54fb6d895ad1-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-268b49c9-8524-42f4-b3aa-2c07d8e83e2b-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Lock "cinder-268b49c9-8524-42f4-b3aa-2c07d8e83e2b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:32 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" acquired by "delete_volume" :: waited 0.023s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:32 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d2a495-0139-44ef-9b86-1ff51a233530]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:32 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:32 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b
Aug 29 13:31:32 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:33 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" returned: 0 in 0.361s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:33 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b
Aug 29 13:31:33 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:33 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-268b49c9-8524-42f4-b3aa-2c07d8e83e2b" released by "delete_volume" :: held 0.666s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Created reservations ['4befe52e-8b8f-41f9-a348-a4e7972e4a88', '81808a9b-0712-48d3-9c92-95089cc3d044', '2ed24c60-a0b7-4b19-8f2b-bee07071aae6', '72baca37-9076-4c11-b67f-efbb6db90d16'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:33 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:33 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:33 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:33 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Deleted volume successfully.
Aug 29 13:31:33 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e41087e1-dd2e-4e7e-903e-e96878e5a97c tempest-ProjectMemberTests-936537036 None] Lock "cinder-268b49c9-8524-42f4-b3aa-2c07d8e83e2b-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (a2811b6b-60a3-4902-a5f5-6be49899a12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94136dfc-e2a0-41d5-8700-2354aa6dadc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94136dfc-e2a0-41d5-8700-2354aa6dadc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1373264397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a1e84d-55ae-4edf-b219-de3d7a25841d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:34Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e40c8e-80e7-47ea-ba20-1d3a2fbcbf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e40c8e-80e7-47ea-ba20-1d3a2fbcbf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1864e4-ea17-4c5e-aa81-a1a6867bf679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1864e4-ea17-4c5e-aa81-a1a6867bf679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a1e84d-55ae-4edf-b219-de3d7a25841d', 'volume_name': 'volume-95a1e84d-55ae-4edf-b219-de3d7a25841d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833b385f-dfb6-4d52-9c7d-a432a33f80a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833b385f-dfb6-4d52-9c7d-a432a33f80a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e5df9c-2c0b-4041-8be4-929cb0427605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:34 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Volume 95a1e84d-55ae-4edf-b219-de3d7a25841d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a1e84d-55ae-4edf-b219-de3d7a25841d', 'volume_size': 1}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1373264397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a1e84d-55ae-4edf-b219-de3d7a25841d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0da73937368406c8b4742fe8e4e9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:34Z,use_quota=True,user_id='0f8cb5efc80a429fa7ad1821bf3dcb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Creating volume 95a1e84d-55ae-4edf-b219-de3d7a25841d {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:31:34 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:34 devstack sudo[105991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d 1073741824
Aug 29 13:31:34 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:34 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d 1073741824" returned: 0 in 0.410s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:34 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:34 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d
Aug 29 13:31:34 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:35 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d" returned: 0 in 0.243s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e5df9c-2c0b-4041-8be4-929cb0427605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a1e84d-55ae-4edf-b219-de3d7a25841d', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516930de-accb-4e9b-82a8-46259ae14136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:35 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Volume volume-95a1e84d-55ae-4edf-b219-de3d7a25841d (95a1e84d-55ae-4edf-b219-de3d7a25841d): created successfully
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516930de-accb-4e9b-82a8-46259ae14136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Flow 'volume_create_manager' (a2811b6b-60a3-4902-a5f5-6be49899a12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:35 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-c5f744c6-4a87-429f-a946-213e281a9bc3 tempest-ProjectMemberTests-936537036 None] Created volume successfully.
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Creating offline snapshot 17201a07-15c6-42f2-9a47-43341b13c762 of volume 95a1e84d-55ae-4edf-b219-de3d7a25841d {{(pid=85771) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff63b30-3095-4a90-8f88-671adbd95de5]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:35 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d
Aug 29 13:31:35 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:35 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d" returned: 0 in 0.352s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:35 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 1G {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:35 devstack sudo[106005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 1G
Aug 29 13:31:35 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:36 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 1G" returned: 0 in 0.383s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95a1e84d-55ae-4edf-b219-de3d7a25841d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:36 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95a1e84d-55ae-4edf-b219-de3d7a25841d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762
Aug 29 13:31:36 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:36 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95a1e84d-55ae-4edf-b219-de3d7a25841d -F qcow2 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762" returned: 0 in 0.291s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:36 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 is being set with open permissions: ugo+rw
Aug 29 13:31:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:36 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762
Aug 29 13:31:36 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:36 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762" returned: 0 in 0.245s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:36 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.info
Aug 29 13:31:36 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:36 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.info" returned: 0 in 0.250s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:36 devstack cinder-volume[85771]: WARNING cinder.volume.drivers.remotefs [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.info is being set with open permissions: ugo+rw
Aug 29 13:31:36 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.info {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:36 devstack sudo[106021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.info
Aug 29 13:31:36 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:37 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.info" returned: 0 in 0.238s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:37 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-6f0e7f28-c0b0-47a5-8e07-9ec4ac0b2a48 tempest-ProjectMemberTests-936537036 None] Create snapshot completed successfully
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-17201a07-15c6-42f2-9a47-43341b13c762-delete_snapshot" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Lock "cinder-17201a07-15c6-42f2-9a47-43341b13c762-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-95a1e84d-55ae-4edf-b219-de3d7a25841d" by "delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-95a1e84d-55ae-4edf-b219-de3d7a25841d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-17201a07-15c6-42f2-9a47-43341b13c762" by "_delete_snapshot" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-17201a07-15c6-42f2-9a47-43341b13c762" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Deleting offline snapshot 17201a07-15c6-42f2-9a47-43341b13c762 of volume 95a1e84d-55ae-4edf-b219-de3d7a25841d {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] snapshot_file for this snap is: volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 {{(pid=85771) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6489983-4ed0-4e70-b603-7938e5f6a9b1]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:37 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:37 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762
Aug 29 13:31:37 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:38 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762" returned: 0 in 0.352s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95a1e84d-55ae-4edf-b219-de3d7a25841d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85771) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e357770-2b08-4c93-bd5e-774963ffb376]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:38 devstack sudo[106029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d
Aug 29 13:31:38 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:38 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d" returned: 0 in 0.360s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:38 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762
Aug 29 13:31:38 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:38 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762" returned: 0 in 0.317s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:38 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762
Aug 29 13:31:38 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:38 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d.17201a07-15c6-42f2-9a47-43341b13c762" returned: 0 in 0.243s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-17201a07-15c6-42f2-9a47-43341b13c762" released by "_delete_snapshot" :: held 1.352s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:38 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-95a1e84d-55ae-4edf-b219-de3d7a25841d" released by "delete_snapshot" :: held 1.373s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:39 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Created reservations ['d5290bcf-acf3-4538-9bde-10c623680045', '3ac99f6e-3c04-4f7f-b4a5-4be483c40070', '63124fdb-0b28-4bf5-9d78-6a0a4e4ed3a4', '422dda30-fab2-4779-b634-2041d5151c55'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:39 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Delete snapshot completed successfully.
Aug 29 13:31:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-e46bb8f6-efaf-4ca5-bb7a-c7e5a8ccb89d tempest-ProjectMemberTests-936537036 None] Lock "cinder-17201a07-15c6-42f2-9a47-43341b13c762-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-95a1e84d-55ae-4edf-b219-de3d7a25841d-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Lock "cinder-95a1e84d-55ae-4edf-b219-de3d7a25841d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Acquiring lock "cinder-quobyte-95a1e84d-55ae-4edf-b219-de3d7a25841d" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:39 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-95a1e84d-55ae-4edf-b219-de3d7a25841d" acquired by "delete_volume" :: waited 0.019s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:39 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b91988-d365-4e60-9fa3-49b00b21b8da]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:39 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:39 devstack sudo[106042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d
Aug 29 13:31:39 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:40 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d" returned: 0 in 0.350s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:40 devstack sudo[106047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d
Aug 29 13:31:40 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:40 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-95a1e84d-55ae-4edf-b219-de3d7a25841d" returned: 0 in 0.241s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Lock "cinder-quobyte-95a1e84d-55ae-4edf-b219-de3d7a25841d" released by "delete_volume" :: held 0.649s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Created reservations ['622d6ea6-fa45-4f9f-9443-36a668902116', '1f726f47-eefb-4021-b314-f60655c7f889', 'e891519e-07a3-4f12-bf2a-2652f1f00889', '72d18535-2752-4440-9f7e-5c868225e2ab'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:40 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:40 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:40 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.240s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:40 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Deleted volume successfully.
Aug 29 13:31:40 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-7d7571dd-c3c7-4608-bc7f-00354f3970d5 tempest-ProjectMemberTests-936537036 None] Lock "cinder-95a1e84d-55ae-4edf-b219-de3d7a25841d-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:50 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=48,cinder:INSERT=19,cinder:UPDATE=58,cinder:DELETE=5 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:31:50 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=48,cinder:INSERT=18,cinder:UPDATE=69,cinder:DELETE=4 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:31:51 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Flow 'volume_create_manager' (fa16e8bc-7f9e-4b43-8dbc-1b20796d34f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449e0e97-95b1-4daf-9865-939839abe423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449e0e97-95b1-4daf-9865-939839abe423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629650297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb151cc-33a7-4af9-bfde-d501972d4601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafae9074ad6487cac68203f21a4be26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:52Z,use_quota=True,user_id='2f02b3595e2442e9b36d870e76547d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d26d607-3a2d-4c8e-88e3-7a640f0a31e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d26d607-3a2d-4c8e-88e3-7a640f0a31e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5974b036-fb53-4430-bf7c-dd911689dd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5974b036-fb53-4430-bf7c-dd911689dd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb151cc-33a7-4af9-bfde-d501972d4601', 'volume_name': 'volume-8cb151cc-33a7-4af9-bfde-d501972d4601', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90966de5-47ee-4b6b-ae4b-b1b4ae8bab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90966de5-47ee-4b6b-ae4b-b1b4ae8bab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8509e313-2cfd-4fed-86d9-e01399005ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Volume 8cb151cc-33a7-4af9-bfde-d501972d4601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb151cc-33a7-4af9-bfde-d501972d4601', 'volume_size': 1}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629650297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb151cc-33a7-4af9-bfde-d501972d4601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafae9074ad6487cac68203f21a4be26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:52Z,use_quota=True,user_id='2f02b3595e2442e9b36d870e76547d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Creating volume 8cb151cc-33a7-4af9-bfde-d501972d4601 {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:31:52 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:52 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601 1073741824
Aug 29 13:31:52 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:52 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601 1073741824" returned: 0 in 0.395s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:52 devstack sudo[106066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601
Aug 29 13:31:52 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:52 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601" returned: 0 in 0.236s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8509e313-2cfd-4fed-86d9-e01399005ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb151cc-33a7-4af9-bfde-d501972d4601', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f03ae5b-cf2d-4aa3-8a24-f6b963612e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:52 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Volume volume-8cb151cc-33a7-4af9-bfde-d501972d4601 (8cb151cc-33a7-4af9-bfde-d501972d4601): created successfully
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f03ae5b-cf2d-4aa3-8a24-f6b963612e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:52 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Flow 'volume_create_manager' (fa16e8bc-7f9e-4b43-8dbc-1b20796d34f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:52 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-dd71bde2-39ba-4a25-bdf8-61da6954dd6f tempest-ProjectReaderTests-439717046 None] Created volume successfully.
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Acquiring lock "cinder-8cb151cc-33a7-4af9-bfde-d501972d4601-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Lock "cinder-8cb151cc-33a7-4af9-bfde-d501972d4601-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Acquiring lock "cinder-quobyte-8cb151cc-33a7-4af9-bfde-d501972d4601" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Lock "cinder-quobyte-8cb151cc-33a7-4af9-bfde-d501972d4601" acquired by "delete_volume" :: waited 0.013s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d564e6-fc18-45af-b020-3a9fa93c2672]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:53 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601
Aug 29 13:31:53 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:53 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601" returned: 0 in 0.360s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:53 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601
Aug 29 13:31:53 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:53 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-8cb151cc-33a7-4af9-bfde-d501972d4601" returned: 0 in 0.246s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Lock "cinder-quobyte-8cb151cc-33a7-4af9-bfde-d501972d4601" released by "delete_volume" :: held 0.642s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Created reservations ['c472b191-0c2c-4126-af1a-47c5f5de9fa9', 'dbd426a5-23f8-4529-a9c9-7810a07a0b5a', '760120f6-4186-4847-af1e-8831e704b4d5', 'd06a0142-691e-440d-bc2b-5e492d55093e'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:53 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:53 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:53 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:54 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.254s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:54 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Deleted volume successfully.
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-70be9992-d3eb-4d38-a637-d3ef640c6dc8 tempest-ProjectReaderTests-439717046 None] Lock "cinder-8cb151cc-33a7-4af9-bfde-d501972d4601-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:54 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:54 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85771) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Flow 'volume_create_manager' (6b421261-bd7f-431a-b1d8-1645d992733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1f3b75-070e-4913-941a-f1db1e6b4268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1f3b75-070e-4913-941a-f1db1e6b4268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564221070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8eb629-633b-4d78-a652-8796a745a55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafae9074ad6487cac68203f21a4be26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:55Z,use_quota=True,user_id='2f02b3595e2442e9b36d870e76547d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3cd945-3b9a-4ed1-8327-4c02fa0ecb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3cd945-3b9a-4ed1-8327-4c02fa0ecb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13014cea-79b4-4781-9473-a12692c58bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13014cea-79b4-4781-9473-a12692c58bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8eb629-633b-4d78-a652-8796a745a55b', 'volume_name': 'volume-7c8eb629-633b-4d78-a652-8796a745a55b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc6940c-bd84-4f7a-9e72-6e9a0d8d4824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc6940c-bd84-4f7a-9e72-6e9a0d8d4824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9bd942-c312-4005-94c0-b51860212833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:54 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Volume 7c8eb629-633b-4d78-a652-8796a745a55b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8eb629-633b-4d78-a652-8796a745a55b', 'volume_size': 1}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b621abd5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-29T11:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564221070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8eb629-633b-4d78-a652-8796a745a55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafae9074ad6487cac68203f21a4be26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-29T11:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-29T11:31:55Z,use_quota=True,user_id='2f02b3595e2442e9b36d870e76547d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(516b5101-8a1d-4d4d-b55e-5b631a49109b),volume_type_id=516b5101-8a1d-4d4d-b55e-5b631a49109b)}" {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.remotefs [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Creating volume 7c8eb629-633b-4d78-a652-8796a745a55b {{(pid=85771) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Selected osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e as target Quobyte volume. {{(pid=85771) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 29 13:31:54 devstack cinder-volume[85771]: INFO cinder.volume.drivers.remotefs [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] casted to osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b 1073741824 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:54 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b 1073741824
Aug 29 13:31:54 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:54 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.261s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG oslo_service.periodic_task [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] Running periodic task VolumeManager._thread_info {{(pid=85771) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread count: 28 {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 29 13:31:54 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-ec2cbb09-4fe0-44b1-8798-363ce39e8ba4 None None] thread info: [<_MainThread(MainThread, started 123927655084160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123927541356544)>, <Thread(Thread-3 (stat_writer), started daemon 123927541836224)>, <Thread(Rabbit-heartbeat, started daemon 123927540563392)>, <Thread(Thread-5 (_runner), started daemon 123927540728512)>, <Thread(Thread-7 (_runner), started daemon 123927540846464)>, <Thread(fd_logger, started daemon 123927538439616)>, <Thread(privsep_reader, started daemon 123927538446400)>, <Thread(tpool_thread_0, started daemon 123927530288832)>, <Thread(tpool_thread_1, started daemon 123927521896128)>, <Thread(tpool_thread_2, started daemon 123927513503424)>, <Thread(tpool_thread_3, started daemon 123927505110720)>, <Thread(tpool_thread_4, started daemon 123927496718016)>, <Thread(tpool_thread_5, started daemon 123927488308928)>, <Thread(tpool_thread_6, started daemon 123927479899840)>, <Thread(tpool_thread_7, started daemon 123927471490752)>, <Thread(tpool_thread_8, started daemon 123927463081664)>, <Thread(tpool_thread_9, started daemon 123927454672576)>, <Thread(tpool_thread_10, started daemon 123927446263488)>, <Thread(tpool_thread_11, started daemon 123927437854400)>, <Thread(tpool_thread_12, started daemon 123927429445312)>, <Thread(tpool_thread_13, started daemon 123927421036224)>, <Thread(tpool_thread_14, started daemon 123927412627136)>, <Thread(tpool_thread_15, started daemon 123927404218048)>, <Thread(tpool_thread_16, started daemon 123927395808960)>, <Thread(tpool_thread_17, started daemon 123927387399872)>, <Thread(tpool_thread_18, started daemon 123927378990784)>, <Thread(tpool_thread_19, started daemon 123927370581696)>] {{(pid=85771) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 29 13:31:55 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b 1073741824" returned: 0 in 0.389s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:55 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b
Aug 29 13:31:55 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:55 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b" returned: 0 in 0.255s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'} {{(pid=85771) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9bd942-c312-4005-94c0-b51860212833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8eb629-633b-4d78-a652-8796a745a55b', 'volume_size': 1}' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6c2c5a-2ed7-438a-a571-19c45108fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 29 13:31:55 devstack cinder-volume[85771]: INFO cinder.volume.flows.manager.create_volume [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Volume volume-7c8eb629-633b-4d78-a652-8796a745a55b (7c8eb629-633b-4d78-a652-8796a745a55b): created successfully
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6c2c5a-2ed7-438a-a571-19c45108fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85771) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Flow 'volume_create_manager' (6b421261-bd7f-431a-b1d8-1645d992733a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85771) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 29 13:31:55 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-e4e561f3-6783-42ac-96fe-135bb21f3e43 tempest-ProjectReaderTests-439717046 None] Created volume successfully.
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Acquiring lock "cinder-7c8eb629-633b-4d78-a652-8796a745a55b-delete_volume" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Lock "cinder-7c8eb629-633b-4d78-a652-8796a745a55b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Acquiring lock "cinder-quobyte-7c8eb629-633b-4d78-a652-8796a745a55b" by "delete_volume" {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Lock "cinder-quobyte-7c8eb629-633b-4d78-a652-8796a745a55b" acquired by "delete_volume" :: waited 0.014s {{(pid=85771) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe860dd-a66a-43bb-ad91-28d9e337f4a0]: (4, 'qcow2') {{(pid=86801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 29 13:31:55 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:55 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b
Aug 29 13:31:55 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:56 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b" returned: 0 in 0.352s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:56 devstack sudo[106097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b
Aug 29 13:31:56 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:56 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6/volume-7c8eb629-633b-4d78-a652-8796a745a55b" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Lock "cinder-quobyte-7c8eb629-633b-4d78-a652-8796a745a55b" released by "delete_volume" :: held 0.629s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG cinder.quota [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Created reservations ['bcedec81-d331-4e5f-80f1-ab629c7499bb', '670e19f2-234c-461c-aaf0-c3f9c7ec8f12', '167e5949-f08f-461a-b50d-8080c1427888', 'e11c4952-e9bf-4587-8c69-e0cc41f913a7'] {{(pid=85771) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e': None} {{(pid=85771) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG cinder.volume.drivers.quobyte [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-91c00509-e54f-449b-93ad-2a459fe90a5e'] {{(pid=85771) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.lockutils [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85771) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6 {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 29 13:31:56 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6
Aug 29 13:31:56 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 29 13:31:56 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG oslo_concurrency.processutils [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/19c9569f3915f62ca0e5120cbd4339c6" returned: 0 in 0.244s {{(pid=85771) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG cinder.manager [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Notifying Schedulers of capabilities ... {{(pid=85771) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 29 13:31:56 devstack cinder-volume[85771]: INFO cinder.volume.manager [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Deleted volume successfully.
Aug 29 13:31:56 devstack cinder-volume[85771]: DEBUG cinder.coordination [None req-043ea371-a7e9-460b-bb9f-1a841ae463d6 tempest-ProjectReaderTests-439717046 None] Lock "cinder-7c8eb629-633b-4d78-a652-8796a745a55b-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=85771) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 29 13:32:06 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:UPDATE=22,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=6 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 29 13:32:06 devstack cinder-volume[85771]: DEBUG dbcounter [-] [85771] Writing DB stats cinder:SELECT=14,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=85771) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}